Aug 28 16:09:52 devstack cinder-volume[75062]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 16:09:52 devstack cinder-volume[75062]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 16:09:52 devstack cinder-volume[75062]: we strongly recommend against using it for new projects. Aug 28 16:09:52 devstack cinder-volume[75062]: If you are already using Eventlet, we recommend migrating to a different Aug 28 16:09:52 devstack cinder-volume[75062]: framework. For more detail see Aug 28 16:09:52 devstack cinder-volume[75062]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 16:09:52 devstack cinder-volume[75062]: import eventlet # noqa Aug 28 16:09:54 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:09:54 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:09:54 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:09:55 devstack cinder-volume[75062]: INFO dbcounter [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Registered counter for database cinder Aug 28 16:09:55 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG dbcounter [-] [75062] Writer thread running {{(pid=75062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:09:56 devstack cinder-volume[75062]: INFO cinder.rpc [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 16:09:56 devstack cinder-volume[75062]: INFO cinder.rpc [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:09:56 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Determined volume DB was empty at startup. Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG cinder.volume.manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75062) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 16:09:56 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 16:09:56 devstack cinder-volume[75062]: WARNING stevedore.named [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 16:09:56 devstack cinder-volume[75062]: WARNING castellan.key_manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:09:56 devstack cinder-volume[75062]: WARNING cinder.keymgr.conf_key_mgr [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG cinder.volume.drivers.lvm [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75062) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG oslo_concurrency.processutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG oslo_concurrency.processutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=75062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:56 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:09:57 devstack cinder-volume[75062]: INFO cinder.rpc [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 28 16:09:57 devstack cinder-volume[75062]: INFO cinder.rpc [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 28 16:09:57 devstack cinder-volume[75062]: WARNING stevedore.named [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 16:09:57 devstack cinder-volume[75062]: WARNING castellan.key_manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:09:57 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:09:57 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Starting 1 workers Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Started child 75222 {{(pid=75062) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Full set of CONF: {{(pid=75062) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] ******************************************************************************** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Configuration options gathered from: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 16:09:57 devstack cinder-volume[75222]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] ================================================================================ {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] allow_availability_zone_fallback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] allow_compression_on_image_upload = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] allowed_direct_url_schemes = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] api_rate_limit = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] auth_strategy = keystone {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] az_cache_duration = 3600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_host = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_stats_polling_interval = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backup_api_class = cinder.backup.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backup_name_template = backup-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backup_use_same_host = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backup_use_temp_snapshot = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] chap_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] chap_username = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_internal_tenant_project_id = 899d47c461e9434da0daf67988c95296 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_internal_tenant_user_id = ad62280ce2304fffb7495741d7fe6490 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cloned_volume_same_az = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cluster = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] compression_format = gzip {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] compute_api_class = cinder.compute.nova.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] config_dir = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] config_source = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] control_exchange = openstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] debug = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] default_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] default_group_type = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] default_volume_type = lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] disk_geometry = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_client_cert = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_client_cert_key = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_data_namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_ssl_cert_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_ssl_cert_verify = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] driver_use_ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] enable_force_upload = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] enable_new_services = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] enable_unsupported_driver = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] enforce_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] filter_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_api_insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_api_ssl_compression = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_ca_certificates_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_catalog_info = image:glance:publicURL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_num_retries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance_request_timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] goodness_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] graceful_shutdown_timeout = 5 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] group_api_class = cinder.group.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] host = devstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_compress_on_upload = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_conversion_address_space_limit = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_conversion_cpu_limit = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_conversion_disable = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_upload_use_cinder_backend = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_upload_use_internal_tenant = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_volume_cache_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_volume_cache_max_count = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: INFO cinder.volume.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] image_volume_cache_max_size_gb = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] init_host_max_objects_retrieval = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] instance_format = [instance: %(uuid)s] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iscsi_target_flags = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iscsi_write_cache = on {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iser_helper = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iser_ip_address = 192.168.122.65 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iser_port = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_color = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_config_append = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_dir = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_options = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_rotate_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_rotate_interval_type = days {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] log_rotation_type = none {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] max_age = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] max_logfile_count = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] max_logfile_size_mb = 200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] max_over_subscription_ratio = 20.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] message_reap_interval = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] message_ttl = 2592000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] migration_create_volume_timeout_secs = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] monkey_patch = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] monkey_patch_modules = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] my_ip = 192.168.122.65 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] no_snapshot_gb_quota = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] num_iser_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] num_shell_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] num_volume_device_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] nvmeof_conn_info_version = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] nvmet_ns_id = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] nvmet_port_id = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_max_limit = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_ext_list = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_listen_port = 8776 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_use_ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] osapi_volume_workers = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] per_volume_size_limit = -1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] periodic_fuzzy_delay = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] periodic_interval = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] public_endpoint = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] publish_errors = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_backup_gigabytes = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_backups = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_gigabytes = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_groups = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_snapshots = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] quota_volumes = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] rate_limit_burst = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] rate_limit_except_level = CRITICAL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] rate_limit_interval = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] reinit_driver_count = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] replication_device = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] report_discard_supported = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] report_interval = 120 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] reservation_clean_interval = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] reservation_expire = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] reserved_image_namespaces = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] reserved_percentage = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] rpc_response_timeout = 120 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] run_external_periodic_tasks = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] scst_target_driver = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] scst_target_iqn_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_down_time = 720 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] shell_completion = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] snapshot_name_template = snapshot-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] snapshot_same_host = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] state_path = /opt/stack/data/cinder {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] storage_availability_zone = nova {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] storage_protocol = iSCSI {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] syslog_log_facility = LOG_USER {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_helper = lioadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_ip_address = 192.168.122.65 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_port = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_protocol = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] target_secondary_ip_addresses = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] trace_flags = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] transport_url = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] until_refresh = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_chap_auth = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_default_quota_class = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_journal = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_json = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_stderr = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] use_syslog = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] verify_glance_signatures = enabled {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_api_class = cinder.volume.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_backend_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_clear = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_clear_ionice = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_clear_size = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_copy_bps_limit = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_dd_blocksize = 1M {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_name_template = volume-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_service_inithost_offload = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volume_usage_audit_period = month {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] zoning_mode = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_concurrency.disable_process_locking = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.auth_type = password {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.auth_version = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.cache = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.include_service_catalog = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.interface = public {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcache_username = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.region_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.service_type = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.backend = dogpile.cache.null {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.backend_argument = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.backend_expiration_time = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.config_prefix = cache.oslo {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.debug_cache_backend = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.enable_retry_client = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.enable_socket_keepalive = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.expiration_time = 600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.hashclient_retry_attempts = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_dead_retry = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_pool_maxsize = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_sasl_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.proxies = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.redis_db = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.redis_server = localhost:6379 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.retry_attempts = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.retry_delay = 0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.socket_keepalive_count = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.socket_keepalive_idle = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.socket_keepalive_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.socket_timeout = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.tls_allowed_ciphers = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.tls_cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.tls_certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.tls_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.tls_keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cache.username = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] coordination.backend_url = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.asyncio_connection = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.asyncio_slave_connection = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.backend = sqlalchemy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.connection = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.connection_debug = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.connection_parameters = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.connection_recycle_time = 3600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.connection_trace = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.db_inc_retry_interval = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.db_max_retries = 20 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.db_max_retry_interval = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.db_retry_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.max_overflow = 50 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.max_pool_size = 5 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.max_retries = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.mysql_wsrep_sync_wait = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.pool_timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.retry_interval = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.slave_connection = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.sqlite_synchronous = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.synchronous_reader = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] database.use_db_reconnect = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack sudo[75227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_tracing.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack sudo[75227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.connection_string = messaging:// {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.es_doc_type = notification {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.es_scroll_size = 10000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.es_scroll_time = 2m {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.filter_error_trace = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.hmac_keys = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.sentinel_service_name = mymaster {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.socket_timeout = 0.1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.trace_requests = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler.trace_sqlalchemy = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler_jaeger.process_tags = {} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler_jaeger.service_name_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] profiler_otlp.service_name_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.enforce_new_defaults = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.policy_default_rule = default {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.policy_file = policy.yaml {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.group = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.helper_command = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] privsep_osbrick.user = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.group = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.helper_command = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] cinder_sys_admin.user = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.auth_type = password {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.collect_timing = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.send_service_user_token = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] service_user.timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.auth_type = password {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.collect_timing = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.region_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] glance.timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.backend_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.chap_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.chap_username = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.disk_geometry = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_client_cert = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_client_cert_key = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_data_namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.driver_use_ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.extra_capabilities = {} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.filter_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.goodness_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iscsi_target_flags = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iscsi_write_cache = on {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iser_helper = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iser_port = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.lvm_share_target = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.lvm_type = auto {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.num_shell_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.replication_device = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.report_discard_supported = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.reserved_percentage = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_helper = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_port = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_protocol = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.trace_flags = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.unique_fqdn_network = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.use_chap_auth = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_backend_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_clear = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_clear_ionice = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_clear_size = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_reports.file_event_handler = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_reports.log_dir = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.backend_host = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.chap_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.chap_username = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.disk_geometry = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_client_cert = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.extra_capabilities = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.filter_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.goodness_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iser_helper = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iser_ip_address = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iser_port = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.lvm_share_target = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.lvm_type = auto {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.num_shell_tries = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.replication_device = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.report_discard_supported = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.reserved_percentage = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.scst_target_driver = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.storage_protocol = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_helper = lioadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_ip_address = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_port = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.trace_flags = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.use_chap_auth = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_clear = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_clear_size = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] lvmdriver-1.volumes_dir = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_notifications.driver = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_notifications.retry = -1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] key_manager.fixed_key = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.barbican_api_version = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.barbican_endpoint = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.barbican_endpoint_type = public {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.barbican_region_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.collect_timing = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.number_of_retries = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.retry_delay = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.send_service_user_token = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.verify_ssl = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican.verify_ssl_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.auth_type = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.collect_timing = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] barbican_service_user.timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.approle_role_id = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.approle_secret_id = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.auth_method = approle {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.auth_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.kv_mountpoint = secret {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.kv_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.kv_version = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.root_token_id = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.ssl_ca_crt_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.timeout = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.token_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.token_role = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.use_ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:09:57 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] ******************************************************************************** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 16:09:57 devstack sudo[75227]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.382s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:57 devstack sudo[75230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:09:57 devstack sudo[75230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:57 devstack sudo[75230]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.332s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:09:57 devstack cinder-volume[75222]: INFO cinder.brick.local_dev.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 28 16:09:57 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:58 devstack sudo[75424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:09:58 devstack sudo[75424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:58 devstack sudo[75424]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG cinder.brick.local_dev.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75222) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:58 devstack sudo[75505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:09:58 devstack sudo[75505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:58 devstack sudo[75505]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:58 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:58 devstack sudo[75715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:09:58 devstack sudo[75715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:59 devstack sudo[75715]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.338s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:59 devstack sudo[75840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 28 16:09:59 devstack sudo[75840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:59 devstack sudo[75840]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.255s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:59 devstack sudo[75843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:09:59 devstack sudo[75843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:09:59 devstack sudo[75843]: pam_unix(sudo:session): session closed for user root Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:09:59 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:09:59 devstack sudo[75923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:09:59 devstack sudo[75923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:00 devstack sudo[75923]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:00 devstack sudo[75929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:00 devstack sudo[75929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:00 devstack sudo[75929]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:00 devstack sudo[75945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:00 devstack sudo[75945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:00 devstack sudo[75945]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:00 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:00 devstack sudo[76024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:00 devstack sudo[76024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:01 devstack sudo[76024]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:01 devstack cinder-volume[75222]: INFO cinder.volume.drivers.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:01 devstack sudo[76028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:01 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:01 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:01 devstack sudo[76031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:10:01 devstack sudo[76031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:01 devstack sudo[76031]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:01 devstack sudo[76034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:01 devstack sudo[76034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:01 devstack sudo[76034]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:01 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:01 devstack sudo[76043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:01 devstack sudo[76043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:02 devstack sudo[76043]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:02 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:02 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:02 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:02 devstack cinder-volume[75222]: INFO cinder.volume.driver [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG cinder.volume.driver [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75222) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_db.sqlalchemy.engines [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writer thread running {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG cinder.db.api [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Building query based on filter {{(pid=75222) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG cinder.image.image_utils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75222) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 16:10:02 devstack cinder-volume[75222]: INFO cinder.keymgr.migration [None req-f35b0783-61a9-4e43-8d60-c1c0087d145d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:02 devstack sudo[76049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:10:02 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:02 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:02 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:02 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:02 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:03 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:03 devstack sudo[76057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:03 devstack sudo[76057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:03 devstack sudo[76057]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:03 devstack sudo[76060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:03 devstack sudo[76060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:03 devstack sudo[76060]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG cinder.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Notifying Schedulers of capabilities ... {{(pid=75222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:10:03 devstack cinder-volume[75222]: INFO cinder.volume.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Driver initialization completed successfully. Aug 28 16:10:03 devstack cinder-volume[75222]: INFO cinder.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Initiating service 2 cleanup Aug 28 16:10:03 devstack cinder-volume[75222]: INFO cinder.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Service 2 cleanup completed. Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG cinder.service [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Creating RPC server for service cinder-volume {{(pid=75222) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG cinder.service [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75222) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 16:10:03 devstack cinder-volume[75222]: INFO cinder.volume.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:10:03 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:04 devstack sudo[76064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:10:04 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:04 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:04 devstack sudo[76068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:04 devstack sudo[76068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:04 devstack sudo[76068]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:04 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:10:04 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:04 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:04 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:10:04 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:10:04 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:10:05 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Aug 28 16:10:05 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:10:05 devstack cinder-volume[75222]: INFO cinder.volume.manager [None req-c43bd975-4c20-4308-b2e8-7c2fa17977e3 None None] Driver post RPC initialization completed successfully. Aug 28 16:10:07 devstack cinder-volume[75062]: DEBUG dbcounter [-] [75062] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:10:15 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writing DB stats cinder:SELECT=3 {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:10:15 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:10:24 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager._thread_info {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:10:24 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread count: 6 {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:10:24 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread info: [<_MainThread(MainThread, started 125472221401216)>, , , , , ] {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:11:24 devstack sudo[78487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:11:24 devstack sudo[78487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:11:24 devstack sudo[78487]: pam_unix(sudo:session): session closed for user root Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:11:24 devstack sudo[78490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:11:24 devstack sudo[78490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:11:24 devstack sudo[78490]: pam_unix(sudo:session): session closed for user root Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:11:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:11:24 devstack sudo[78524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:11:24 devstack sudo[78524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:11:25 devstack sudo[78524]: pam_unix(sudo:session): session closed for user root Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:11:25 devstack sudo[78612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:11:25 devstack sudo[78612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:11:25 devstack sudo[78612]: pam_unix(sudo:session): session closed for user root Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG cinder.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Notifying Schedulers of capabilities ... {{(pid=75222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager._thread_info {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread count: 6 {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:11:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread info: [<_MainThread(MainThread, started 125472221401216)>, , , , , ] {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:12:15 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writing DB stats cinder:SELECT=1 {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:12:15 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writing DB stats cinder:UPDATE=1 {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:12:24 devstack sudo[81692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:12:24 devstack sudo[81692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:12:24 devstack sudo[81692]: pam_unix(sudo:session): session closed for user root Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:12:24 devstack sudo[81695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:12:24 devstack sudo[81695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:12:24 devstack sudo[81695]: pam_unix(sudo:session): session closed for user root Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:12:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:12:24 devstack sudo[81699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:12:24 devstack sudo[81699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:12:25 devstack sudo[81699]: pam_unix(sudo:session): session closed for user root Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:12:25 devstack sudo[81702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:12:25 devstack sudo[81702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:12:25 devstack sudo[81702]: pam_unix(sudo:session): session closed for user root Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG cinder.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Notifying Schedulers of capabilities ... {{(pid=75222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager._thread_info {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread count: 6 {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:12:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread info: [<_MainThread(MainThread, started 125472221401216)>, , , , , ] {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:13:24 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:13:24 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:13:24 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:13:24 devstack sudo[83747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:13:24 devstack sudo[83747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:13:24 devstack sudo[83747]: pam_unix(sudo:session): session closed for user root Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:13:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:13:24 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:13:24 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:13:25 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:13:25 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:13:25 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:13:25 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG cinder.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Notifying Schedulers of capabilities ... {{(pid=75222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager._thread_info {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread count: 6 {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:13:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread info: [<_MainThread(MainThread, started 125472221401216)>, , , , , ] {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:14:15 devstack cinder-volume[75222]: DEBUG dbcounter [-] [75222] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG cinder.volume.drivers.lvm [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Updating volume stats {{(pid=75222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:24 devstack sudo[84825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 16:14:24 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:24 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:24 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:14:24 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:24 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:24 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:24 devstack sudo[84834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 16:14:24 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:25 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:25 devstack sudo[84837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 16:14:25 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:25 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG oslo_concurrency.processutils [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG cinder.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Notifying Schedulers of capabilities ... {{(pid=75222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG oslo_service.periodic_task [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] Running periodic task VolumeManager._thread_info {{(pid=75222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread count: 6 {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:14:25 devstack cinder-volume[75222]: DEBUG cinder.volume.manager [None req-0d190de7-4a4d-4760-a9c1-b8ce53584fc0 None None] thread info: [<_MainThread(MainThread, started 125472221401216)>, , , , , ] {{(pid=75222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:14:37 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Caught SIGTERM, stopping children Aug 28 16:14:37 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Acquiring lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:37 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Acquired lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:37 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Releasing lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:37 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Stop services. {{(pid=75062) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 16:14:37 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Killing children. {{(pid=75062) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 16:14:37 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Waiting on 1 children to exit Aug 28 16:14:38 devstack cinder-volume[75222]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Acquiring lock "singleton_lock" {{(pid=75222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:38 devstack cinder-volume[75222]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Acquired lock "singleton_lock" {{(pid=75222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:38 devstack cinder-volume[75222]: DEBUG oslo_concurrency.lockutils [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Releasing lock "singleton_lock" {{(pid=75222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:38 devstack cinder-volume[75222]: WARNING amqp [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 16:14:38 devstack cinder-volume[75222]: WARNING amqp [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 16:14:38 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-1f922145-d7fd-4521-a151-d0b1855fa908 None None] Child 75222 exited with status 0 Aug 28 16:14:39 devstack cinder-volume[85233]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 16:14:39 devstack cinder-volume[85233]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 16:14:39 devstack cinder-volume[85233]: we strongly recommend against using it for new projects. Aug 28 16:14:39 devstack cinder-volume[85233]: If you are already using Eventlet, we recommend migrating to a different Aug 28 16:14:39 devstack cinder-volume[85233]: framework. For more detail see Aug 28 16:14:39 devstack cinder-volume[85233]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 16:14:39 devstack cinder-volume[85233]: import eventlet # noqa Aug 28 16:14:41 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:41 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:41 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:42 devstack cinder-volume[85233]: INFO dbcounter [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Registered counter for database cinder Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_db.sqlalchemy.engines [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG dbcounter [-] [85233] Writer thread running {{(pid=85233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:14:42 devstack cinder-volume[85233]: INFO cinder.rpc [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 16:14:42 devstack cinder-volume[85233]: INFO cinder.rpc [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_db.sqlalchemy.engines [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:42 devstack cinder-volume[85233]: INFO cinder.volume.manager [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Determined volume DB was empty at startup. Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG cinder.volume.manager [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85233) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 16:14:42 devstack cinder-volume[85233]: INFO cinder.volume.manager [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 16:14:42 devstack cinder-volume[85233]: WARNING stevedore.named [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 16:14:42 devstack cinder-volume[85233]: WARNING castellan.key_manager [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:14:42 devstack cinder-volume[85233]: WARNING cinder.keymgr.conf_key_mgr [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:14:42 devstack cinder-volume[85233]: INFO cinder.volume.manager [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_db.sqlalchemy.engines [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:42 devstack cinder-volume[85233]: INFO oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Starting 1 workers Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Started child 85449 {{(pid=85233) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Full set of CONF: {{(pid=85233) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] ******************************************************************************** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Configuration options gathered from: {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] ================================================================================ {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] allow_availability_zone_fallback = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] allow_compression_on_image_upload = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] allowed_direct_url_schemes = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] api_rate_limit = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] auth_strategy = keystone {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85449]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_availability_zone = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_host = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_stats_polling_interval = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backup_api_class = cinder.backup.api.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backup_name_template = backup-%s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backup_use_same_host = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backup_use_temp_snapshot = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] chap_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] chap_username = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_internal_tenant_project_id = 899d47c461e9434da0daf67988c95296 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_internal_tenant_user_id = ad62280ce2304fffb7495741d7fe6490 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cluster = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] compression_format = gzip {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] compute_api_class = cinder.compute.nova.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] config_dir = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] config_source = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] control_exchange = openstack {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] debug = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] default_availability_zone = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] default_group_type = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] default_volume_type = QuobyteHD {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] disk_geometry = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_client_cert = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_client_cert_key = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_data_namespace = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_ssl_cert_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_ssl_cert_verify = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] driver_use_ssl = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] enable_new_services = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] enable_unsupported_driver = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] enabled_backends = ['QuobyteHD'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] enforce_multipath_for_image_xfer = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] filter_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_api_insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_api_ssl_compression = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_ca_certificates_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_catalog_info = image:glance:publicURL {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_num_retries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance_request_timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] goodness_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] graceful_shutdown_timeout = 5 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] group_api_class = cinder.group.api.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] host = devstack {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_compress_on_upload = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_conversion_address_space_limit = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_conversion_cpu_limit = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_conversion_disable = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_upload_use_cinder_backend = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_upload_use_internal_tenant = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_volume_cache_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_volume_cache_max_count = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] image_volume_cache_max_size_gb = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] init_host_max_objects_retrieval = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] instance_format = [instance: %(uuid)s] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iscsi_target_flags = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iscsi_write_cache = on {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iser_helper = tgtadm {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iser_ip_address = 192.168.122.65 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iser_port = 3260 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_color = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_config_append = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_dir = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_options = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85449]: INFO cinder.volume.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 16:14:42 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.remotefs [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85449) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_rotate_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_rotate_interval_type = days {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] log_rotation_type = none {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] max_age = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] max_logfile_count = 30 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] max_logfile_size_mb = 200 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] max_over_subscription_ratio = 20.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] message_reap_interval = 86400 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] message_ttl = 2592000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] migration_create_volume_timeout_secs = 300 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] monkey_patch = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] monkey_patch_modules = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] my_ip = 192.168.122.65 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:42 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] no_snapshot_gb_quota = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] num_iser_scan_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] num_shell_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] num_volume_device_scan_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] nvmeof_conn_info_version = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] nvmet_ns_id = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] nvmet_port_id = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_max_limit = 1000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_ext_list = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_listen_port = 8776 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_use_ssl = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] osapi_volume_workers = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] per_volume_size_limit = -1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] periodic_fuzzy_delay = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] periodic_interval = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] public_endpoint = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] publish_errors = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_backup_gigabytes = 1000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_backups = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_gigabytes = 1000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_groups = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_snapshots = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] quota_volumes = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] rate_limit_burst = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] rate_limit_except_level = CRITICAL {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] rate_limit_interval = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] reinit_driver_count = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] replication_device = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] report_discard_supported = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] report_interval = 120 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] reservation_clean_interval = 86400 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] reservation_expire = 86400 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] reserved_image_namespaces = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] reserved_percentage = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] rpc_response_timeout = 120 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] run_external_periodic_tasks = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] scst_target_driver = iscsi {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] scst_target_iqn_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_down_time = 720 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] shell_completion = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] snapshot_name_template = snapshot-%s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] split_loggers = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] state_path = /opt/stack/data/cinder {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] storage_availability_zone = nova {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] storage_protocol = iSCSI {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] syslog_log_facility = LOG_USER {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_helper = lioadm {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_ip_address = 192.168.122.65 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_port = 3260 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_protocol = iscsi {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] target_secondary_ip_addresses = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] trace_flags = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] transport_url = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] until_refresh = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_chap_auth = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_default_quota_class = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_journal = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_json = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_multipath_for_image_xfer = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_stderr = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] use_syslog = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] verify_glance_signatures = enabled {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_api_class = cinder.volume.api.API {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_backend_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_clear = zero {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_clear_ionice = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_clear_size = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_copy_bps_limit = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_dd_blocksize = 1M {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_name_template = volume-%s {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_service_inithost_offload = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volume_usage_audit_period = month {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] zoning_mode = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_concurrency.disable_process_locking = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.auth_section = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.auth_type = password {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.auth_version = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.cache = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.include_service_catalog = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.interface = public {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcache_username = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.region_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.service_type = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.backend = dogpile.cache.null {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.backend_argument = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.backend_expiration_time = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.config_prefix = cache.oslo {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.debug_cache_backend = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.enable_retry_client = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.enable_socket_keepalive = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.expiration_time = 600 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.hashclient_retry_attempts = 2 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_dead_retry = 300 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_pool_maxsize = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_sasl_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.proxies = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.redis_db = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85449) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 16:14:43 devstack cinder-volume[85449]: WARNING cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 16:14:43 devstack cinder-volume[85449]: WARNING cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.redis_server = localhost:6379 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.retry_attempts = 2 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.retry_delay = 0.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.socket_keepalive_count = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.socket_keepalive_idle = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.socket_keepalive_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Running cmd (subprocess): mount.quobyte {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.socket_timeout = 1.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.tls_allowed_ciphers = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.tls_cafile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.tls_certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.tls_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.tls_keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cache.username = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] coordination.backend_url = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.asyncio_connection = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.asyncio_slave_connection = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.backend = sqlalchemy {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.connection = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.connection_debug = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.connection_parameters = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.connection_recycle_time = 3600 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.connection_trace = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.db_inc_retry_interval = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.db_max_retries = 20 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.db_max_retry_interval = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.db_retry_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.max_overflow = 50 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.max_pool_size = 5 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.max_retries = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.mysql_wsrep_sync_wait = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.pool_timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.retry_interval = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.slave_connection = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.sqlite_synchronous = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.synchronous_reader = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] database.use_db_reconnect = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_tracing.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.connection_string = messaging:// {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.es_doc_type = notification {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.es_scroll_size = 10000 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.es_scroll_time = 2m {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.filter_error_trace = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.hmac_keys = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.sentinel_service_name = mymaster {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.socket_timeout = 0.1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.trace_requests = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler.trace_sqlalchemy = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler_jaeger.process_tags = {} {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler_jaeger.service_name_prefix = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] profiler_otlp.service_name_prefix = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.enforce_new_defaults = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.policy_default_rule = default {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.policy_file = policy.yaml {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.group = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.helper_command = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] privsep_osbrick.user = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.group = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.helper_command = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] cinder_sys_admin.user = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.auth_section = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.auth_type = password {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.cafile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.collect_timing = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.send_service_user_token = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.split_loggers = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] service_user.timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.auth_section = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.auth_type = password {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.collect_timing = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.region_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.split_loggers = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] glance.timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.backend_availability_zone = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.chap_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.chap_username = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.disk_geometry = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_client_cert = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_client_cert_key = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_data_namespace = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.driver_use_ssl = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.extra_capabilities = {} {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.filter_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.goodness_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iscsi_target_flags = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iscsi_write_cache = on {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iser_helper = tgtadm {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iser_port = 3260 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_host = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_login = admin {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_mount_options = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_private_key = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_share_path = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.num_shell_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.quobyte_volume_url = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.replication_device = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.report_discard_supported = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.reserved_percentage = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack quobyte-client[85454]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_helper = tgtadm {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_port = 3260 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack quobyte-client[85454]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_protocol = iscsi {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.trace_flags = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.unique_fqdn_network = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.use_chap_auth = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_backend_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_clear = zero {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_clear_ionice = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_clear_size = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_reports.file_event_handler = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=85449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_reports.log_dir = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.backend_availability_zone = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: INFO cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa ... Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.backend_host = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 -c /etc/quobyte/client-cinder.cfg {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.chap_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.chap_username = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.chiscsi_conf = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.disk_geometry = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_client_cert = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_data_namespace = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.driver_use_ssl = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.extra_capabilities = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.filter_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.goodness_function = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iser_helper = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iser_ip_address = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iser_port = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.iser_target_prefix = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_host = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_login = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_mount_options = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_password = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_private_key = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_share_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_ssh_port = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.num_shell_tries = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.nvmet_port_id = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.replication_device = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.report_discard_supported = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.reserved_percentage = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.scst_target_driver = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.storage_protocol = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_helper = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_ip_address = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_port = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_prefix = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_protocol = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.trace_flags = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.use_chap_auth = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_clear = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_clear_size = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] QuobyteHD.volumes_dir = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 -c /etc/quobyte/client-cinder.cfg Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_notifications.driver = [] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_notifications.retry = -1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] key_manager.fixed_key = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.barbican_api_version = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.barbican_endpoint = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.barbican_endpoint_type = public {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.barbican_region_name = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.cafile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.collect_timing = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.number_of_retries = 60 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.retry_delay = 1 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.send_service_user_token = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.split_loggers = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.verify_ssl = True {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican.verify_ssl_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.auth_section = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.auth_type = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.cafile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.certfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.collect_timing = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.insecure = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.keyfile = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.split_loggers = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] barbican_service_user.timeout = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.approle_role_id = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.approle_secret_id = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.auth_method = approle {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.auth_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.kv_mountpoint = secret {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.kv_path = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.kv_version = 2 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.namespace = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.root_token_id = **** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.ssl_ca_crt_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.timeout = 60.0 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.token_file = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.token_role = None {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.use_ssl = False {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:43 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] ******************************************************************************** {{(pid=85233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 16:14:43 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.527s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:43 devstack cinder-volume[85449]: INFO cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa succeeded Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=85449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.546s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:43 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:43 devstack sudo[85536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:43 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:44 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.341s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:44 devstack cinder-volume[85449]: INFO cinder.volume.driver [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.volume.driver [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.487995147705, 'free_capacity_gb': 1774.487995147705, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_db.sqlalchemy.engines [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG dbcounter [-] [85449] Writer thread running {{(pid=85449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.db.api [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Building query based on filter {{(pid=85449) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.image.image_utils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 16:14:44 devstack cinder-volume[85449]: INFO cinder.keymgr.migration [None req-ad3dc3fc-6ca5-4c6e-a553-d9017504c8ba None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=85449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=85449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:44 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:44 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:44 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.393s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Notifying Schedulers of capabilities ... {{(pid=85449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:14:44 devstack cinder-volume[85449]: INFO cinder.volume.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Driver initialization completed successfully. Aug 28 16:14:44 devstack cinder-volume[85449]: INFO cinder.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Initiating service 3 cleanup Aug 28 16:14:44 devstack cinder-volume[85449]: INFO cinder.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Service 3 cleanup completed. Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.service [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Creating RPC server for service cinder-volume {{(pid=85449) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 16:14:44 devstack cinder-volume[85449]: DEBUG cinder.service [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85449) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 16:14:45 devstack cinder-volume[85449]: INFO cinder.volume.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=85449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=85449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:45 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:45 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:45 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:45 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.510s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:45 devstack cinder-volume[85449]: INFO cinder.volume.manager [None req-259f9035-9f74-417e-adef-4d8b0d501cc0 None None] Driver post RPC initialization completed successfully. Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=85449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG cinder.volume.drivers.quobyte [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=85449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:49 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:49 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:49 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG oslo_concurrency.processutils [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.299s {{(pid=85449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:49 devstack cinder-volume[85449]: DEBUG cinder.manager [None req-52e01fb4-8a8c-4716-8282-08cc00fef625 None None] Notifying Schedulers of capabilities ... {{(pid=85449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:14:50 devstack cinder-volume[85233]: INFO oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Caught SIGTERM, stopping children Aug 28 16:14:50 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Acquiring lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:50 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Acquired lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:50 devstack cinder-volume[85233]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Releasing lock "singleton_lock" {{(pid=85233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:50 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Stop services. {{(pid=85233) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 16:14:50 devstack cinder-volume[85233]: DEBUG oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Killing children. {{(pid=85233) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 16:14:50 devstack cinder-volume[85233]: INFO oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Waiting on 1 children to exit Aug 28 16:14:53 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Acquiring lock "singleton_lock" {{(pid=85449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:53 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Acquired lock "singleton_lock" {{(pid=85449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:53 devstack cinder-volume[85449]: DEBUG oslo_concurrency.lockutils [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Releasing lock "singleton_lock" {{(pid=85449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:53 devstack cinder-volume[85449]: WARNING amqp [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 16:14:53 devstack cinder-volume[85449]: WARNING amqp [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 16:14:53 devstack cinder-volume[85233]: INFO oslo_service.backend._eventlet.service [None req-a2f1abe8-2ba2-4f09-a0c4-497111fd0f11 None None] Child 85449 exited with status 0 Aug 28 16:14:54 devstack cinder-volume[85880]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 16:14:54 devstack cinder-volume[85880]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 16:14:54 devstack cinder-volume[85880]: we strongly recommend against using it for new projects. Aug 28 16:14:54 devstack cinder-volume[85880]: If you are already using Eventlet, we recommend migrating to a different Aug 28 16:14:54 devstack cinder-volume[85880]: framework. For more detail see Aug 28 16:14:54 devstack cinder-volume[85880]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 16:14:54 devstack cinder-volume[85880]: import eventlet # noqa Aug 28 16:14:56 devstack cinder-volume[85880]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 16:14:56 devstack cinder-volume[85880]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 16:14:56 devstack cinder-volume[85880]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 16:14:57 devstack cinder-volume[85880]: INFO dbcounter [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Registered counter for database cinder Aug 28 16:14:57 devstack cinder-volume[85880]: DEBUG oslo_db.sqlalchemy.engines [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG dbcounter [-] [85880] Writer thread running {{(pid=85880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:14:58 devstack cinder-volume[85880]: INFO cinder.rpc [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 16:14:58 devstack cinder-volume[85880]: INFO cinder.rpc [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_db.sqlalchemy.engines [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:58 devstack cinder-volume[85880]: INFO cinder.volume.manager [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Determined volume DB was empty at startup. Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG cinder.volume.manager [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85880) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 16:14:58 devstack cinder-volume[85880]: WARNING stevedore.named [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 16:14:58 devstack cinder-volume[85880]: WARNING castellan.key_manager [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:14:58 devstack cinder-volume[85880]: WARNING cinder.keymgr.conf_key_mgr [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 16:14:58 devstack cinder-volume[85880]: INFO cinder.volume.manager [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_db.sqlalchemy.engines [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:58 devstack cinder-volume[85880]: INFO oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Starting 1 workers Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Started child 86193 {{(pid=85880) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Full set of CONF: {{(pid=85880) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] ******************************************************************************** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] Configuration options gathered from: {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] ================================================================================ {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] allow_availability_zone_fallback = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] allow_compression_on_image_upload = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] allowed_direct_url_schemes = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] api_rate_limit = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] auth_strategy = keystone {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_availability_zone = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_host = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_stats_polling_interval = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backup_api_class = cinder.backup.api.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backup_name_template = backup-%s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backup_use_same_host = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backup_use_temp_snapshot = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] chap_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] chap_username = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_internal_tenant_project_id = 899d47c461e9434da0daf67988c95296 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_internal_tenant_user_id = ad62280ce2304fffb7495741d7fe6490 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cluster = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] compression_format = gzip {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] compute_api_class = cinder.compute.nova.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] config_dir = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] config_source = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] control_exchange = openstack {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] debug = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] default_availability_zone = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] default_group_type = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] default_volume_type = QuobyteHD {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] disk_geometry = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_client_cert = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_client_cert_key = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_data_namespace = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[86193]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_ssl_cert_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_ssl_cert_verify = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] driver_use_ssl = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] enable_new_services = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] enable_unsupported_driver = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] enabled_backends = ['QuobyteHD'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] enforce_multipath_for_image_xfer = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] filter_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_api_insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_api_servers = ['http://192.168.122.65/image'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_api_ssl_compression = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_ca_certificates_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_catalog_info = image:glance:publicURL {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_num_retries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance_request_timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] goodness_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] graceful_shutdown_timeout = 5 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] group_api_class = cinder.group.api.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] host = devstack {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_compress_on_upload = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_conversion_address_space_limit = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_conversion_cpu_limit = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_conversion_disable = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_upload_use_cinder_backend = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_upload_use_internal_tenant = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_volume_cache_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_volume_cache_max_count = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] image_volume_cache_max_size_gb = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] init_host_max_objects_retrieval = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] instance_format = [instance: %(uuid)s] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iscsi_target_flags = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iscsi_write_cache = on {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iser_helper = tgtadm {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iser_ip_address = 192.168.122.65 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iser_port = 3260 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_color = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_config_append = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_dir = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_options = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_rotate_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_rotate_interval_type = days {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] log_rotation_type = none {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] max_age = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] max_logfile_count = 30 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] max_logfile_size_mb = 200 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] max_over_subscription_ratio = 20.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] message_reap_interval = 86400 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] message_ttl = 2592000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] migration_create_volume_timeout_secs = 300 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] monkey_patch = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] monkey_patch_modules = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] my_ip = 192.168.122.65 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] no_snapshot_gb_quota = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] num_iser_scan_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] num_shell_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] num_volume_device_scan_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] nvmeof_conn_info_version = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] nvmet_ns_id = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] nvmet_port_id = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_max_limit = 1000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_ext_list = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_listen_port = 8776 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_use_ssl = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] osapi_volume_workers = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] per_volume_size_limit = -1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] periodic_fuzzy_delay = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] periodic_interval = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] public_endpoint = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] publish_errors = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_backup_gigabytes = 1000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_backups = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_gigabytes = 1000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_groups = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_snapshots = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] quota_volumes = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] rate_limit_burst = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] rate_limit_except_level = CRITICAL {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] rate_limit_interval = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] reinit_driver_count = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] replication_device = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] report_discard_supported = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] report_interval = 120 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] reservation_clean_interval = 86400 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] reservation_expire = 86400 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] reserved_image_namespaces = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] reserved_percentage = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] rpc_response_timeout = 120 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] run_external_periodic_tasks = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] scst_target_driver = iscsi {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] scst_target_iqn_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_down_time = 720 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] shell_completion = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] snapshot_name_template = snapshot-%s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] split_loggers = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] state_path = /opt/stack/data/cinder {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] storage_availability_zone = nova {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] storage_protocol = iSCSI {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] syslog_log_facility = LOG_USER {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_helper = lioadm {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_ip_address = 192.168.122.65 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_port = 3260 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_protocol = iscsi {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] target_secondary_ip_addresses = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] trace_flags = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] transport_url = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] until_refresh = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_chap_auth = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_default_quota_class = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_journal = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_json = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_multipath_for_image_xfer = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_stderr = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] use_syslog = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] verify_glance_signatures = enabled {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_api_class = cinder.volume.api.API {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_backend_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_clear = zero {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_clear_ionice = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_clear_size = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_copy_bps_limit = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_dd_blocksize = 1M {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_name_template = volume-%s {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_service_inithost_offload = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volume_usage_audit_period = month {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] zoning_mode = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_concurrency.disable_process_locking = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.auth_section = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.auth_type = password {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.auth_version = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.cache = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.include_service_catalog = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.interface = public {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcache_username = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.region_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.service_type = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.backend = dogpile.cache.null {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.backend_argument = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.backend_expiration_time = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.config_prefix = cache.oslo {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.debug_cache_backend = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.enable_retry_client = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.enable_socket_keepalive = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.expiration_time = 600 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.hashclient_retry_attempts = 2 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_dead_retry = 300 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_pool_maxsize = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_sasl_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.proxies = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.redis_db = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.redis_server = localhost:6379 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.retry_attempts = 2 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.retry_delay = 0.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.socket_keepalive_count = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.socket_keepalive_idle = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.socket_keepalive_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.socket_timeout = 1.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.tls_allowed_ciphers = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.tls_cafile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.tls_certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.tls_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.tls_keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cache.username = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] coordination.backend_url = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.asyncio_connection = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.asyncio_slave_connection = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.backend = sqlalchemy {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.connection = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.connection_debug = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.connection_parameters = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.connection_recycle_time = 3600 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.connection_trace = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.db_inc_retry_interval = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.db_max_retries = 20 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.db_max_retry_interval = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.db_retry_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.max_overflow = 50 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.max_pool_size = 5 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.max_retries = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.mysql_wsrep_sync_wait = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.pool_timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.retry_interval = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.slave_connection = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.sqlite_synchronous = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.synchronous_reader = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] database.use_db_reconnect = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86193) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_tracing.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.connection_string = messaging:// {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.es_doc_type = notification {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.es_scroll_size = 10000 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.es_scroll_time = 2m {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.filter_error_trace = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.hmac_keys = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.sentinel_service_name = mymaster {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.socket_timeout = 0.1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.trace_requests = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler.trace_sqlalchemy = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler_jaeger.process_tags = {} {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler_jaeger.service_name_prefix = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] profiler_otlp.service_name_prefix = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.enforce_new_defaults = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.policy_default_rule = default {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.policy_file = policy.yaml {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.group = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.helper_command = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:58 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] privsep_osbrick.user = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.group = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.helper_command = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] cinder_sys_admin.user = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.auth_section = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.auth_type = password {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.cafile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.collect_timing = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.send_service_user_token = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.split_loggers = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] service_user.timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.auth_section = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.auth_type = password {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.collect_timing = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.region_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.split_loggers = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] glance.timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.backend_availability_zone = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.chap_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.chap_username = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.disk_geometry = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_client_cert = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_client_cert_key = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_data_namespace = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.driver_use_ssl = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.extra_capabilities = {} {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.filter_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.goodness_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iscsi_target_flags = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iscsi_write_cache = on {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iser_helper = tgtadm {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iser_port = 3260 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_host = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_login = admin {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_mount_options = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_private_key = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_share_path = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.num_shell_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.quobyte_volume_url = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.replication_device = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.report_discard_supported = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.reserved_percentage = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_helper = tgtadm {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_port = 3260 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_protocol = iscsi {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.trace_flags = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.unique_fqdn_network = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.use_chap_auth = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_backend_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_clear = zero {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_clear_ionice = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_clear_size = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_reports.file_event_handler = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_reports.log_dir = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.backend_availability_zone = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.backend_host = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.chap_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.chap_username = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.chiscsi_conf = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.disk_geometry = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_client_cert = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_data_namespace = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.driver_use_ssl = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.extra_capabilities = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.filter_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.goodness_function = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iser_helper = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iser_ip_address = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iser_port = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.iser_target_prefix = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_host = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_login = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_mount_options = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_password = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_private_key = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_share_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_ssh_port = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.num_shell_tries = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.nvmet_port_id = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.replication_device = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.report_discard_supported = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.reserved_percentage = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.scst_target_driver = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.storage_protocol = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_helper = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_ip_address = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_port = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_prefix = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_protocol = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.trace_flags = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack quobyte-client[86204]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.use_chap_auth = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_clear = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack quobyte-client[86204]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86193) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 16:14:59 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 16:14:59 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_clear_size = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] QuobyteHD.volumes_dir = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Running cmd (subprocess): mount.quobyte {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_notifications.driver = [] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_notifications.retry = -1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] key_manager.fixed_key = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.barbican_api_version = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.barbican_endpoint = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.barbican_endpoint_type = public {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.barbican_region_name = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.cafile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.collect_timing = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.number_of_retries = 60 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.retry_delay = 1 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.send_service_user_token = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.split_loggers = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.verify_ssl = True {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican.verify_ssl_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.auth_section = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.auth_type = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.cafile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.certfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.collect_timing = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.insecure = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.keyfile = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.split_loggers = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] barbican_service_user.timeout = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.approle_role_id = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.approle_secret_id = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.auth_method = approle {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.auth_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.kv_mountpoint = secret {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.kv_path = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.kv_version = 2 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.namespace = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.root_token_id = **** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.ssl_ca_crt_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.timeout = 60.0 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.token_file = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.token_role = None {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.use_ssl = False {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 16:14:59 devstack cinder-volume[85880]: DEBUG oslo_service.backend._eventlet.service [None req-25d53cdf-1b3a-46d2-a280-725982486172 None None] ******************************************************************************** {{(pid=85880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:59 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:59 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:59 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:59 devstack cinder-volume[86193]: INFO cinder.volume.driver [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.driver [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5247650146484, 'free_capacity_gb': 1774.5247650146484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86193) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writer thread running {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.db.api [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Building query based on filter {{(pid=86193) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86193) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:14:59 devstack cinder-volume[86193]: INFO cinder.keymgr.migration [None req-fe70e4c8-f982-4fe3-b7f5-f14d80431d2f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 16:14:59 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:14:59 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:14:59 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.280s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:14:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Driver initialization completed successfully. Aug 28 16:14:59 devstack cinder-volume[86193]: INFO cinder.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Initiating service 3 cleanup Aug 28 16:14:59 devstack cinder-volume[86193]: INFO cinder.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Service 3 cleanup completed. Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.service [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Creating RPC server for service cinder-volume {{(pid=86193) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 16:14:59 devstack cinder-volume[86193]: DEBUG cinder.service [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86193) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 16:15:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:15:00 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:15:00 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:15:00 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Aug 28 16:15:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.336s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:15:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad6172d9-a2f9-46ad-a6d9-a88d36de1698 None None] Driver post RPC initialization completed successfully. Aug 28 16:15:08 devstack cinder-volume[85880]: DEBUG dbcounter [-] [85880] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:15:09 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:15:10 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=2 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:15:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:15:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 6 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:15:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Flow 'volume_create_manager' (2d822217-e3dc-408f-a3f5-0c9820ad3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4a8f85-c2fe-413e-9caf-3964fe433b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4a8f85-c2fe-413e-9caf-3964fe433b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-682821242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8504bad-5667-402d-ab54-13579fc19fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41729b17439842ff87ff04bdd9bc5307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:15:59Z,use_quota=True,user_id='914b99cc928d47dfac24b1ca96b5fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df1ebc4-9d5b-492a-8876-00051907497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df1ebc4-9d5b-492a-8876-00051907497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd93a8aa-a610-4f13-978c-3b0ddc2c6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd93a8aa-a610-4f13-978c-3b0ddc2c6721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8504bad-5667-402d-ab54-13579fc19fae', 'volume_name': 'volume-b8504bad-5667-402d-ab54-13579fc19fae', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396d5f4c-2b49-4dcf-b04d-956abb3382f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396d5f4c-2b49-4dcf-b04d-956abb3382f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d91caf-3843-4b2b-8758-0a268c74d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:15:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Volume b8504bad-5667-402d-ab54-13579fc19fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8504bad-5667-402d-ab54-13579fc19fae', 'volume_size': 1} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-682821242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8504bad-5667-402d-ab54-13579fc19fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41729b17439842ff87ff04bdd9bc5307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:15:59Z,use_quota=True,user_id='914b99cc928d47dfac24b1ca96b5fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Creating volume b8504bad-5667-402d-ab54-13579fc19fae {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:15:59 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:15:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:15:59 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae 1073741824 Aug 28 16:15:59 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:00 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae 1073741824" returned: 0 in 1.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:00 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae Aug 28 16:16:00 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:01 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae" returned: 0 in 0.616s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d91caf-3843-4b2b-8758-0a268c74d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8504bad-5667-402d-ab54-13579fc19fae', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131b0f3f-30ed-4ce4-bd66-89af79d98bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Volume volume-b8504bad-5667-402d-ab54-13579fc19fae (b8504bad-5667-402d-ab54-13579fc19fae): created successfully Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131b0f3f-30ed-4ce4-bd66-89af79d98bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Flow 'volume_create_manager' (2d822217-e3dc-408f-a3f5-0c9820ad3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7aa0f27d-c9d6-4730-8b97-9035842e2114 tempest-TaggedAttachmentsTest-1189693567 None] Created volume successfully. Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Flow 'volume_create_manager' (af8b0b58-bb3f-4c6f-b634-3e294c70ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598f9556-8722-4df3-bc90-e35f9f680cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598f9556-8722-4df3-bc90-e35f9f680cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1890235476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b39c5ee-ba99-4ed7-995e-dd23f30e1452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a859f1fde4497ebf87149df0b73b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:04Z,use_quota=True,user_id='bebce5b73be643d59d182616af0d1ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3d674-3829-45af-af58-ddff03183e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3d674-3829-45af-af58-ddff03183e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd74e9ab-c350-44e5-8ab0-b598a8992a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd74e9ab-c350-44e5-8ab0-b598a8992a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b39c5ee-ba99-4ed7-995e-dd23f30e1452', 'volume_name': 'volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b932f0b4-3d14-4a54-9a38-ac10b2819a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b932f0b4-3d14-4a54-9a38-ac10b2819a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7040f9cd-9903-40fb-aa24-eb2c0dbc2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Volume 3b39c5ee-ba99-4ed7-995e-dd23f30e1452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452', 'volume_size': 1} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1890235476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b39c5ee-ba99-4ed7-995e-dd23f30e1452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98a859f1fde4497ebf87149df0b73b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:04Z,use_quota=True,user_id='bebce5b73be643d59d182616af0d1ea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Creating volume 3b39c5ee-ba99-4ed7-995e-dd23f30e1452 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:16:04 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:16:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:04 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 1073741824 Aug 28 16:16:04 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:06 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 1073741824" returned: 0 in 1.534s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:06 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 Aug 28 16:16:06 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:06 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" returned: 0 in 0.394s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7040f9cd-9903-40fb-aa24-eb2c0dbc2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6016be27-ce96-4330-b738-154c047ede21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Volume volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 (3b39c5ee-ba99-4ed7-995e-dd23f30e1452): created successfully Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6016be27-ce96-4330-b738-154c047ede21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Flow 'volume_create_manager' (af8b0b58-bb3f-4c6f-b634-3e294c70ada0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-16a467a6-914f-4420-8a5a-151ccc0c82f7 tempest-DeleteServersTestJSON-50587112 None] Created volume successfully. Aug 28 16:16:15 devstack cinder-volume[86193]: WARNING py.warnings [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 28 16:16:15 devstack cinder-volume[86193]: .first() Aug 28 16:16:15 devstack cinder-volume[86193]: Aug 28 16:16:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93861b03-dd92-4dbd-af51-568741d5a381', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:16:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-e388af1e-7087-41a7-bfac-ec4f1554fcaa req-c721eb5f-c40d-4b43-bb59-739c3fff41a3 tempest-DeleteServersTestJSON-50587112 None] attachment_update completed successfully. Aug 28 16:16:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-76caa3ba-2fbe-4eb2-a311-79a094025311 req-c70ec025-0a09-41cf-95b1-5cd1a308ad63 tempest-DeleteServersTestJSON-50587112 None] Terminate volume connection completed successfully. Aug 28 16:16:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-76caa3ba-2fbe-4eb2-a311-79a094025311 req-c70ec025-0a09-41cf-95b1-5cd1a308ad63 tempest-DeleteServersTestJSON-50587112 None] Deleting attachment 93861b03-dd92-4dbd-af51-568741d5a381. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:16:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "cinder-3b39c5ee-ba99-4ed7-995e-dd23f30e1452-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:16:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "cinder-3b39c5ee-ba99-4ed7-995e-dd23f30e1452-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:16:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "cinder-quobyte-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:16:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "cinder-quobyte-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:16:25 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpt3gbcup1/privsep.sock'] Aug 28 16:16:25 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpt3gbcup1/privsep.sock Aug 28 16:16:25 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 16:16:26 devstack cinder-volume[86193]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 28 16:16:26 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:26 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Spawned new privsep daemon via rootwrap Aug 28 16:16:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Accepted privsep connection to /tmp/tmpt3gbcup1/privsep.sock {{(pid=86193) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 28 16:16:26 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 28 16:16:26 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 28 16:16:26 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 28 16:16:26 devstack cinder-volume[86193]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87665 Aug 28 16:16:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6461a146-a6cc-4564-9c78-721a3f6c77c7]: (2,) {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:16:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840f57c-16c6-4bbf-adeb-947305de81e2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:16:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:27 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 Aug 28 16:16:27 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:27 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" returned: 0 in 0.626s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:27 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452 Aug 28 16:16:27 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:27 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "cinder-quobyte-3b39c5ee-ba99-4ed7-995e-dd23f30e1452" released by "delete_volume" :: held 2.976s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:16:28 devstack cinder-volume[86193]: WARNING cinder.quota [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:16:28 devstack cinder-volume[86193]: WARNING cinder.quota [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Created reservations ['b0087f1c-1121-4af9-8e05-6b3ff00e2493', 'b22a964e-5a40-4582-bf66-0eb5d1b3d862', '17dcb0bc-cdee-45dd-99e0-0b2007c6dd47', '573b0063-8049-4b8f-8796-5a86c98071ec'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:28 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:16:28 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:28 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.473s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:16:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Deleted volume successfully. Aug 28 16:16:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b254e7a1-1166-4b79-93f9-c1f6fc097da2 tempest-DeleteServersTestJSON-50587112 None] Lock "cinder-3b39c5ee-ba99-4ed7-995e-dd23f30e1452-delete_volume" released by "delete_volume" :: held 3.868s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:31 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:16:31 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:31 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.350s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 8 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:16:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (5675099f-d9d0-4efe-9926-06a53d3aff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f9a3cf-f5c8-42f7-b00d-9d7ed5ba7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f9a3cf-f5c8-42f7-b00d-9d7ed5ba7bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-854062487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cafe9a-426f-4701-b112-0b753fa29a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:34Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab75db1-437b-4fa4-be42-7b303669c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab75db1-437b-4fa4-be42-7b303669c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1743886-88d7-4a12-8fa5-6a9d52470402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1743886-88d7-4a12-8fa5-6a9d52470402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cafe9a-426f-4701-b112-0b753fa29a99', 'volume_name': 'volume-a1cafe9a-426f-4701-b112-0b753fa29a99', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2877dee5-2c46-4c57-b310-47b7ba31c406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2877dee5-2c46-4c57-b310-47b7ba31c406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97748b04-ebcd-4917-84a3-deced77eed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:34 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Volume a1cafe9a-426f-4701-b112-0b753fa29a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cafe9a-426f-4701-b112-0b753fa29a99', 'volume_size': 1} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-854062487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cafe9a-426f-4701-b112-0b753fa29a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:34Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Creating volume a1cafe9a-426f-4701-b112-0b753fa29a99 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:16:34 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:16:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:34 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 1073741824 Aug 28 16:16:34 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:35 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 1073741824" returned: 0 in 0.669s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:35 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 Aug 28 16:16:35 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:35 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97748b04-ebcd-4917-84a3-deced77eed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cafe9a-426f-4701-b112-0b753fa29a99', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b760b4-b279-402b-809d-696178b9981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:35 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Volume volume-a1cafe9a-426f-4701-b112-0b753fa29a99 (a1cafe9a-426f-4701-b112-0b753fa29a99): created successfully Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b760b4-b279-402b-809d-696178b9981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (5675099f-d9d0-4efe-9926-06a53d3aff7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8d3021f5-1cc0-40ea-9b0a-da936982233b tempest-AttachVolumeNegativeTest-149611832 None] Created volume successfully. Aug 28 16:16:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6124f660-be25-4ab2-8f40-7a3be35a9697 req-1dc8448a-3576-470a-b2dd-039150788dcb tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6124f660-be25-4ab2-8f40-7a3be35a9697 req-1dc8448a-3576-470a-b2dd-039150788dcb tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6124f660-be25-4ab2-8f40-7a3be35a9697 req-1dc8448a-3576-470a-b2dd-039150788dcb tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-6124f660-be25-4ab2-8f40-7a3be35a9697 req-1dc8448a-3576-470a-b2dd-039150788dcb tempest-AttachVolumeNegativeTest-149611832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-a1cafe9a-426f-4701-b112-0b753fa29a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8532cc21-ed9f-41fe-b83c-d205fac48db4', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:16:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-6124f660-be25-4ab2-8f40-7a3be35a9697 req-1dc8448a-3576-470a-b2dd-039150788dcb tempest-AttachVolumeNegativeTest-149611832 None] attachment_update completed successfully. Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Flow 'volume_create_manager' (97f33875-94eb-490b-ac98-82c2d8fbaa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaea4bd-aac0-4718-9235-bce8295a8cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaea4bd-aac0-4718-9235-bce8295a8cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1417867848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a189c5c1-d22b-4d0e-a23b-2b9919c67aa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f66607cbd747b1a42c062f9d39e2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:44Z,use_quota=True,user_id='ca3d01b67aa1419e94955589593bf042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9683abbe-488a-41d2-8fc9-86b6849904bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9683abbe-488a-41d2-8fc9-86b6849904bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52228f3-6a5c-46e9-ba99-a9112eeee039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52228f3-6a5c-46e9-ba99-a9112eeee039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a189c5c1-d22b-4d0e-a23b-2b9919c67aa3', 'volume_name': 'volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe9c1b6-17c1-448c-957f-0b616bdfcebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe9c1b6-17c1-448c-957f-0b616bdfcebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e9182e-bd5f-466b-a192-ebbc355e0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:44 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Volume a189c5c1-d22b-4d0e-a23b-2b9919c67aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3', 'volume_size': 1} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1417867848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a189c5c1-d22b-4d0e-a23b-2b9919c67aa3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f66607cbd747b1a42c062f9d39e2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:44Z,use_quota=True,user_id='ca3d01b67aa1419e94955589593bf042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Creating volume a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:16:44 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:16:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:44 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 1073741824 Aug 28 16:16:44 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:45 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 1073741824" returned: 0 in 0.700s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:45 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 Aug 28 16:16:45 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:45 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e9182e-bd5f-466b-a192-ebbc355e0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2cb7b-254a-4423-85d8-1a9d6d297607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Volume volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 (a189c5c1-d22b-4d0e-a23b-2b9919c67aa3): created successfully Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc2cb7b-254a-4423-85d8-1a9d6d297607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Flow 'volume_create_manager' (97f33875-94eb-490b-ac98-82c2d8fbaa86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-f358f7e8-d8f3-4375-b9c4-0f67ee4efc1c req-bc001539-1ad9-4403-b905-0a6a82d83ec5 tempest-VolumesGetTestJSON-385222935 None] Created volume successfully. Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Acquiring lock "cinder-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "cinder-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Acquiring lock "cinder-quobyte-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "cinder-quobyte-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb309e8-0f73-4683-bc69-07f76b130a4d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:16:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:47 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 Aug 28 16:16:47 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:48 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" returned: 0 in 0.481s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:48 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3 Aug 28 16:16:48 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:48 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" returned: 0 in 0.305s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "cinder-quobyte-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3" released by "delete_volume" :: held 0.849s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG cinder.quota [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Created reservations ['6e379050-7727-400e-b79b-0aa2941e167e', 'd706823a-dc1e-424e-842d-416a917990e5', '9df4c17c-cedc-4c6b-8d49-5f22f60203ca', '601ec414-bc00-4d8d-b2df-0a5f4f80db6a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:48 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:16:48 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:48 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.336s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:48 devstack cinder-volume[86193]: DEBUG cinder.manager [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:16:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Deleted volume successfully. Aug 28 16:16:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-718cf085-cbad-4b45-a629-67c13f821e11 req-a3674edd-c188-4019-bf4a-18773ec55338 tempest-VolumesGetTestJSON-385222935 None] Lock "cinder-a189c5c1-d22b-4d0e-a23b-2b9919c67aa3-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:16:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=29,cinder:SELECT=29,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:16:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e3786cc6-fe43-45e1-9f45-c976a1282e4d tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1992157819: creating Aug 28 16:16:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=37,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:16:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e3786cc6-fe43-45e1-9f45-c976a1282e4d tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1992157819: created successfully Aug 28 16:16:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e3786cc6-fe43-45e1-9f45-c976a1282e4d tempest-GroupSnapshotsTest-481713576 None] Create group completed successfully. Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (7d3c4ba5-8e0b-4777-bf78-9e37cb03b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf364d7-59b0-4578-90bc-200d3936c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf364d7-59b0-4578-90bc-200d3936c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650621217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c698dfdf-6a16-4aa2-89f2-d53d1c684ced,host='devstack@QuobyteHD#QuobyteHD',id=d26cfd97-11a2-4868-92cf-cf5621b03549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:58Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98ae934-3310-4ba6-875c-3c21e2c46ad8),volume_type_id=d98ae934-3310-4ba6-875c-3c21e2c46ad8)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca29e079-1b9b-4eae-b5cc-4940828e2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca29e079-1b9b-4eae-b5cc-4940828e2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99c15e9-a22d-4396-bebe-012dfbf9f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99c15e9-a22d-4396-bebe-012dfbf9f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26cfd97-11a2-4868-92cf-cf5621b03549', 'volume_name': 'volume-d26cfd97-11a2-4868-92cf-cf5621b03549', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e680b1bc-7a22-481c-ab55-0c9e60e3909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e680b1bc-7a22-481c-ab55-0c9e60e3909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2377c4-8ae9-4393-8ae6-393a8a1590c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Volume d26cfd97-11a2-4868-92cf-cf5621b03549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26cfd97-11a2-4868-92cf-cf5621b03549', 'volume_size': 1} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c698dfdf-6a16-4aa2-89f2-d53d1c684ced,created_at=2026-08-28T14:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650621217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c698dfdf-6a16-4aa2-89f2-d53d1c684ced,host='devstack@QuobyteHD#QuobyteHD',id=d26cfd97-11a2-4868-92cf-cf5621b03549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:16:58Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d98ae934-3310-4ba6-875c-3c21e2c46ad8),volume_type_id=d98ae934-3310-4ba6-875c-3c21e2c46ad8)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Creating volume d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:16:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:58 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 1073741824 Aug 28 16:16:58 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:58 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 1073741824" returned: 0 in 0.521s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:16:58 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:16:58 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:16:59 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.390s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2377c4-8ae9-4393-8ae6-393a8a1590c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26cfd97-11a2-4868-92cf-cf5621b03549', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e0127a-e16d-4686-8151-05ae8d4c3195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:16:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Volume volume-d26cfd97-11a2-4868-92cf-cf5621b03549 (d26cfd97-11a2-4868-92cf-cf5621b03549): created successfully Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e0127a-e16d-4686-8151-05ae8d4c3195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:16:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (7d3c4ba5-8e0b-4777-bf78-9e37cb03b981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:16:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-448fdbf8-e5f5-4dbc-9d9b-bb2f0cb3622d tempest-GroupSnapshotsTest-481713576 None] Created volume successfully. Aug 28 16:17:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] GroupSnapshot d437694b-0e04-45a7-b81e-a183a7957e9e: creating. Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Group snapshot d437694b-0e04-45a7-b81e-a183a7957e9e: creating. {{(pid=86193) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Creating offline snapshot 265b033c-7e54-48bb-90f3-b2ff20b54015 of volume d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a7fc3-b387-4cd3-9a2d-6e384cb0cc3d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:01 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:17:01 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:01 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.427s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:01 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 1G Aug 28 16:17:01 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:02 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 1G" returned: 0 in 0.691s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26cfd97-11a2-4868-92cf-cf5621b03549 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:02 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26cfd97-11a2-4868-92cf-cf5621b03549 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:02 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:02 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d26cfd97-11a2-4868-92cf-cf5621b03549 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.438s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:02 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:02 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:02 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:03 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.381s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:03 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info Aug 28 16:17:03 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:03 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info" returned: 0 in 0.552s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:03 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:03 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info Aug 28 16:17:03 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:04 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.info" returned: 0 in 0.354s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-eccdc95c-7c90-4a1e-8efb-f053a2251927 tempest-GroupSnapshotsTest-481713576 None] group_snapshot d437694b-0e04-45a7-b81e-a183a7957e9e: created successfully Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Creating volume 7a618b9b-23e9-4a44-aa4f-2553d9ec3488 from snapshot 265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" acquired by "_copy_volume_from_snapshot" :: waited 0.082s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] snapshot: 265b033c-7e54-48bb-90f3-b2ff20b54015, volume: 7a618b9b-23e9-4a44-aa4f-2553d9ec3488, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce92b2-bed3-427c-baca-5627b5d8333f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:07 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:07 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:07 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.768s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d26cfd97-11a2-4868-92cf-cf5621b03549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:17:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83c1ef6-034e-4de9-93cf-bea87e59a09e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:07 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:17:07 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5742c4b-0c3b-4374-a1b8-e2dc68925265 req-61859588-2f0c-47a9-9788-e598db465272 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:08 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.591s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:17:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:08 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 Aug 28 16:17:08 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:14 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" returned: 0 in 5.851s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:17:14 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Converted 1024.00 MB image at 174.97 MB/s Aug 28 16:17:14 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:14 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 Aug 28 16:17:14 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:14 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" returned: 0 in 0.273s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" released by "_copy_volume_from_snapshot" :: held 7.733s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" released by "_create_volume_from_snapshot" :: held 7.921s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.977s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5742c4b-0c3b-4374-a1b8-e2dc68925265 req-61859588-2f0c-47a9-9788-e598db465272 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.431s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5742c4b-0c3b-4374-a1b8-e2dc68925265 req-61859588-2f0c-47a9-9788-e598db465272 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.168s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-e5742c4b-0c3b-4374-a1b8-e2dc68925265 req-61859588-2f0c-47a9-9788-e598db465272 tempest-TaggedAttachmentsTest-1189693567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-b8504bad-5667-402d-ab54-13579fc19fae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1906b5e-1dcf-4c5f-9772-2bf83e93cfa1', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:17:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c13c9a02-65fe-4fb5-9ea4-3a25db3b626b tempest-GroupSnapshotsTest-481713576 None] Create group from source-snapshot-d437694b-0e04-45a7-b81e-a183a7957e9e completed successfully. Aug 28 16:17:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-e5742c4b-0c3b-4374-a1b8-e2dc68925265 req-61859588-2f0c-47a9-9788-e598db465272 tempest-TaggedAttachmentsTest-1189693567 None] attachment_update completed successfully. Aug 28 16:17:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da54bda-c18e-4c52-827b-3226fd1a84e6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:16 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 Aug 28 16:17:16 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:16 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" returned: 0 in 0.473s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:16 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488 Aug 28 16:17:16 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:16 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" returned: 0 in 0.477s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-7a618b9b-23e9-4a44-aa4f-2553d9ec3488" released by "delete_volume" :: held 1.045s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-abf58f2a-5048-4993-babe-f327f1f184ab req-6f2ebf5b-9a3a-4225-8677-15eb98b921bd tempest-TaggedAttachmentsTest-1189693567 None] Terminate volume connection completed successfully. Aug 28 16:17:16 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-abf58f2a-5048-4993-babe-f327f1f184ab req-6f2ebf5b-9a3a-4225-8677-15eb98b921bd tempest-TaggedAttachmentsTest-1189693567 None] Deleting attachment e1906b5e-1dcf-4c5f-9772-2bf83e93cfa1. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Created reservations ['edc45b14-e5b1-4fc4-85ad-b9465c96c693'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:17 devstack cinder-volume[86193]: WARNING cinder.quota [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1819577499 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1819577499, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:17 devstack cinder-volume[86193]: WARNING cinder.quota [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1819577499 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1819577499, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Created reservations ['bcd776b4-a8d0-455e-919d-60cbf9c88406', '3457998e-68e1-4092-be4f-b669d36ccf0f', 'bfe353d1-a552-45d4-ad28-b94f30ea5290', '6f558337-4452-4def-b08a-6b4225d3f7d9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:17 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:17:17 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:17 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:17 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:17:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-db98717f-b4ca-408c-8886-2456073bca3b tempest-GroupSnapshotsTest-481713576 None] Delete group completed successfully. Aug 28 16:17:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] group_snapshot d437694b-0e04-45a7-b81e-a183a7957e9e: deleting Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] group_snapshot d437694b-0e04-45a7-b81e-a183a7957e9e: deleting {{(pid=86193) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Deleting offline snapshot 265b033c-7e54-48bb-90f3-b2ff20b54015 of volume d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] snapshot_file for this snap is: volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cde4756-431e-42e3-84a8-a77261793976]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:19 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:19 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:19 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.552s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d26cfd97-11a2-4868-92cf-cf5621b03549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:17:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b39f1-64d7-476e-96a5-c50f537fa027]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:19 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:17:19 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:20 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.796s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:20 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:20 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:20 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:20 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015 Aug 28 16:17:20 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:21 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549.265b033c-7e54-48bb-90f3-b2ff20b54015" returned: 0 in 0.382s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-265b033c-7e54-48bb-90f3-b2ff20b54015" released by "_delete_snapshot" :: held 2.335s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" released by "delete_snapshot" :: held 2.370s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:21 devstack cinder-volume[86193]: WARNING cinder.quota [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1819577499 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1819577499, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:21 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['f9531b31-797e-46e7-ac3d-698d8e65fdee', 'cae7ea0d-a8df-434e-85a3-4ad5d63d956a', '22e58803-c483-4696-8a25-59488336eb31', '5c63ce2c-11b1-49bb-a5b5-24cb90a828a3'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3a8d7c42-49dc-4ae9-870d-ae1ef2708cb1 tempest-GroupSnapshotsTest-481713576 None] group_snapshot d437694b-0e04-45a7-b81e-a183a7957e9e: deleted successfully Aug 28 16:17:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830b93f-9e6b-4153-94c8-4891b9913945]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:22 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:17:22 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:23 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.577s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:23 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549 Aug 28 16:17:23 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:23 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d26cfd97-11a2-4868-92cf-cf5621b03549" returned: 0 in 0.333s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-d26cfd97-11a2-4868-92cf-cf5621b03549" released by "delete_volume" :: held 1.075s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['599287aa-755a-4159-b60d-bebcd99d3ec7'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:23 devstack cinder-volume[86193]: WARNING cinder.db.api [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1819577499'] Aug 28 16:17:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['fe240e3b-8739-402d-b34f-4b112986c1ae', 'c07767d5-2f98-4790-a301-472fd7c3bafe', 'a08ea648-f608-497b-9d9d-09bb8d419a3d', '02318113-7935-44f8-8671-42b5b2176140'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:24 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:17:24 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:24 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.433s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:24 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:17:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ced91a0c-8c87-430b-9403-20bd857e4579 tempest-GroupSnapshotsTest-481713576 None] Delete group completed successfully. Aug 28 16:17:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-03aa56c6-7f99-46b2-bfea-ff0b2fe93070 tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1521926125: creating Aug 28 16:17:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-03aa56c6-7f99-46b2-bfea-ff0b2fe93070 tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1521926125: created successfully Aug 28 16:17:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-03aa56c6-7f99-46b2-bfea-ff0b2fe93070 tempest-GroupSnapshotsTest-481713576 None] Create group completed successfully. Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (fb80ee8c-f1f9-473b-b591-41be9035428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41c34a9-a9b0-4938-95e5-adc4374f6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41c34a9-a9b0-4938-95e5-adc4374f6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625707843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,host='devstack@QuobyteHD#QuobyteHD',id=48ef1da0-def5-46cc-94eb-e7008bd06864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:27Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18196323-dc11-4428-a24f-7e165c0a5acb),volume_type_id=18196323-dc11-4428-a24f-7e165c0a5acb)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c82d6b-8d32-43d6-9367-3c8ae87d4796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c82d6b-8d32-43d6-9367-3c8ae87d4796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50815ae7-dbba-43e0-b074-ef16005d5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50815ae7-dbba-43e0-b074-ef16005d5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ef1da0-def5-46cc-94eb-e7008bd06864', 'volume_name': 'volume-48ef1da0-def5-46cc-94eb-e7008bd06864', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4e9e0-27ab-4b7d-90dc-c5558c1f8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd4e9e0-27ab-4b7d-90dc-c5558c1f8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc61e9-7919-4f4e-9cf6-9e5ce69e9ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Volume 48ef1da0-def5-46cc-94eb-e7008bd06864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ef1da0-def5-46cc-94eb-e7008bd06864', 'volume_size': 1} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,created_at=2026-08-28T14:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625707843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,host='devstack@QuobyteHD#QuobyteHD',id=48ef1da0-def5-46cc-94eb-e7008bd06864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:27Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18196323-dc11-4428-a24f-7e165c0a5acb),volume_type_id=18196323-dc11-4428-a24f-7e165c0a5acb)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Creating volume 48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:17:27 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:27 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 1073741824 Aug 28 16:17:27 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:27 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 1073741824" returned: 0 in 0.551s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:27 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 Aug 28 16:17:27 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:27 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864" returned: 0 in 0.318s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bc61e9-7919-4f4e-9cf6-9e5ce69e9ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ef1da0-def5-46cc-94eb-e7008bd06864', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf70a8-570d-4acd-96b0-131c844ead8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Volume volume-48ef1da0-def5-46cc-94eb-e7008bd06864 (48ef1da0-def5-46cc-94eb-e7008bd06864): created successfully Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf70a8-570d-4acd-96b0-131c844ead8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (fb80ee8c-f1f9-473b-b591-41be9035428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:17:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5762a6a6-084b-4121-b124-822139a9e07e tempest-GroupSnapshotsTest-481713576 None] Created volume successfully. Aug 28 16:17:28 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:17:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (8ad69bd1-3615-40ac-97d4-3f3d006aa2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:17:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b563889-a8d1-4c5b-9f07-a116df26f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b563889-a8d1-4c5b-9f07-a116df26f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437847222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,host='devstack@QuobyteHD#QuobyteHD',id=5892dc49-7f9e-4c77-9c5c-49eac1352264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:29Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18196323-dc11-4428-a24f-7e165c0a5acb),volume_type_id=18196323-dc11-4428-a24f-7e165c0a5acb)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b65e8d4-3f91-41cc-8ab0-f152bc29b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b65e8d4-3f91-41cc-8ab0-f152bc29b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3188b3e6-19d5-4b8c-b3bd-c6c2d0f300b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3188b3e6-19d5-4b8c-b3bd-c6c2d0f300b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5892dc49-7f9e-4c77-9c5c-49eac1352264', 'volume_name': 'volume-5892dc49-7f9e-4c77-9c5c-49eac1352264', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd05521-2b11-46ee-9988-f573866b0d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd05521-2b11-46ee-9988-f573866b0d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a38ca-52a5-4850-8b10-4182b67e7765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Volume 5892dc49-7f9e-4c77-9c5c-49eac1352264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5892dc49-7f9e-4c77-9c5c-49eac1352264', 'volume_size': 1} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,created_at=2026-08-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437847222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e66db6d-6992-4ec2-ac40-f59fbae62c70,host='devstack@QuobyteHD#QuobyteHD',id=5892dc49-7f9e-4c77-9c5c-49eac1352264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:29Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18196323-dc11-4428-a24f-7e165c0a5acb),volume_type_id=18196323-dc11-4428-a24f-7e165c0a5acb)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Creating volume 5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:17:29 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:29 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 1073741824 Aug 28 16:17:29 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:29 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 1073741824" returned: 0 in 0.559s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:29 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 Aug 28 16:17:29 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:30 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264" returned: 0 in 0.418s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2a38ca-52a5-4850-8b10-4182b67e7765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5892dc49-7f9e-4c77-9c5c-49eac1352264', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16af41f2-f692-4a63-80bd-33ef9dc85285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:30 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Volume volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 (5892dc49-7f9e-4c77-9c5c-49eac1352264): created successfully Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16af41f2-f692-4a63-80bd-33ef9dc85285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (8ad69bd1-3615-40ac-97d4-3f3d006aa2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:17:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-33093a34-ec07-4a1b-b516-44fd5f798900 tempest-GroupSnapshotsTest-481713576 None] Created volume successfully. Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "cinder-b8504bad-5667-402d-ab54-13579fc19fae-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "cinder-b8504bad-5667-402d-ab54-13579fc19fae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "cinder-quobyte-b8504bad-5667-402d-ab54-13579fc19fae" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "cinder-quobyte-b8504bad-5667-402d-ab54-13579fc19fae" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704eaad-cd95-41b9-878a-3899d21da0de]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:30 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae Aug 28 16:17:30 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:30 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae" returned: 0 in 0.564s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:30 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae Aug 28 16:17:30 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:31 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b8504bad-5667-402d-ab54-13579fc19fae" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "cinder-quobyte-b8504bad-5667-402d-ab54-13579fc19fae" released by "delete_volume" :: held 0.897s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Created reservations ['f9091596-d6ed-4961-8b95-b44f2c51517c', '9a81bc0e-7c2f-44f8-a4eb-2195d351cb9d', '8bdcd3a6-a568-463a-982f-fc6f29e83c15', '9f461b2c-9c10-4dd9-b20c-649d03d26161'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:31 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:31 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:31 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:17:31 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-956e18cb-0116-4906-8027-7325eacefe18 tempest-GroupSnapshotsTest-481713576 None] Update group completed successfully. Aug 28 16:17:31 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.428s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:17:31 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.456s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:17:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Deleted volume successfully. Aug 28 16:17:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7d12ae8c-4f76-42f9-a595-3417e7d6f812 tempest-TaggedAttachmentsTest-1189693567 None] Lock "cinder-b8504bad-5667-402d-ab54-13579fc19fae-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-08ad14da-c291-458d-9eca-99d045f99ba3 tempest-GroupSnapshotsTest-481713576 None] Update group completed successfully. Aug 28 16:17:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8c7f6685-25d2-42a9-9f3a-be37c8bbb0b6 tempest-GroupSnapshotsTest-481713576 None] Update group completed successfully. Aug 28 16:17:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1a076b90-c8b2-4413-a0a6-a55f9fe408a9 tempest-GroupSnapshotsTest-481713576 None] Update group completed successfully. Aug 28 16:17:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] GroupSnapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: creating. Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Group snapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: creating. {{(pid=86193) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Creating offline snapshot 440f766e-ce99-4ccc-b3c3-69d35a05f01b of volume 48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b82b35-b97d-49fd-a81a-5298908c7ca7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:37 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 Aug 28 16:17:37 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:38 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864" returned: 0 in 0.580s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:38 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b 1G Aug 28 16:17:38 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:38 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b 1G" returned: 0 in 0.654s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ef1da0-def5-46cc-94eb-e7008bd06864 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:38 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ef1da0-def5-46cc-94eb-e7008bd06864 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b Aug 28 16:17:38 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:39 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ef1da0-def5-46cc-94eb-e7008bd06864 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b" returned: 0 in 0.503s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:39 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:39 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b Aug 28 16:17:39 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:39 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b" returned: 0 in 0.367s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:39 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info Aug 28 16:17:39 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:40 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info" returned: 0 in 0.469s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:40 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:40 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info Aug 28 16:17:40 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:40 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.info" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Creating offline snapshot 71b8f87f-606e-4f27-af93-235c8659641c of volume 5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d6e9fe-5f9f-4c32-a3a6-39ba020eb9ce]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:40 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 Aug 28 16:17:40 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:41 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264" returned: 0 in 0.480s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:41 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c 1G Aug 28 16:17:41 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:41 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c 1G" returned: 0 in 0.630s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:41 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c Aug 28 16:17:41 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:42 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c" returned: 0 in 0.530s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:42 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:42 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c Aug 28 16:17:42 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-aeef32f5-aede-4cbf-8b39-c642da921501 req-0c2b2f3c-003e-4bfd-b353-4a468553139a tempest-AttachVolumeNegativeTest-149611832 None] Terminate volume connection completed successfully. Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-aeef32f5-aede-4cbf-8b39-c642da921501 req-0c2b2f3c-003e-4bfd-b353-4a468553139a tempest-AttachVolumeNegativeTest-149611832 None] Deleting attachment 8532cc21-ed9f-41fe-b83c-d205fac48db4. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:17:42 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:42 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info Aug 28 16:17:42 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:42 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:42 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:17:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:43 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info Aug 28 16:17:43 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:43 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.info" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6986b2b8-fff3-43fe-8415-ccf486a5f4dc tempest-GroupSnapshotsTest-481713576 None] group_snapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: created successfully Aug 28 16:17:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] group_snapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: deleting Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] group_snapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: deleting {{(pid=86193) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-440f766e-ce99-4ccc-b3c3-69d35a05f01b" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-440f766e-ce99-4ccc-b3c3-69d35a05f01b" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Deleting offline snapshot 440f766e-ce99-4ccc-b3c3-69d35a05f01b of volume 48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] snapshot_file for this snap is: volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22abc67-df5e-4f3e-b1e9-6a723100149f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:44 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b Aug 28 16:17:44 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:45 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b" returned: 0 in 0.646s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ef1da0-def5-46cc-94eb-e7008bd06864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[22167416-6bc7-408d-b529-04902244c93f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:45 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 Aug 28 16:17:45 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:45 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864" returned: 0 in 0.407s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:45 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b Aug 28 16:17:45 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:46 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b" returned: 0 in 0.522s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:46 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b Aug 28 16:17:46 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:46 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864.440f766e-ce99-4ccc-b3c3-69d35a05f01b" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-440f766e-ce99-4ccc-b3c3-69d35a05f01b" released by "_delete_snapshot" :: held 2.159s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" released by "delete_snapshot" :: held 2.228s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-71b8f87f-606e-4f27-af93-235c8659641c" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-71b8f87f-606e-4f27-af93-235c8659641c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Deleting offline snapshot 71b8f87f-606e-4f27-af93-235c8659641c of volume 5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] snapshot_file for this snap is: volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b6087-e0f3-4bae-8ace-e6f01cadcc34]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:47 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c Aug 28 16:17:47 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:47 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c" returned: 0 in 0.469s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5892dc49-7f9e-4c77-9c5c-49eac1352264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:17:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fbf037-1056-4851-b08f-bc6e0cffb924]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:47 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 Aug 28 16:17:47 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:48 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264" returned: 0 in 0.527s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:48 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c Aug 28 16:17:48 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:48 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c" returned: 0 in 0.548s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:48 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c Aug 28 16:17:48 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:48 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264.71b8f87f-606e-4f27-af93-235c8659641c" returned: 0 in 0.428s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-71b8f87f-606e-4f27-af93-235c8659641c" released by "_delete_snapshot" :: held 2.133s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" released by "delete_snapshot" :: held 2.169s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:49 devstack cinder-volume[86193]: WARNING cinder.quota [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-769434309 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-769434309, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:49 devstack cinder-volume[86193]: WARNING cinder.quota [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-769434309 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-769434309, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Created reservations ['a3407209-4f19-4d97-8f44-9978197bbb5b', 'fcadbaf0-2d9b-4d18-a3c0-c22c6a005b99', '93095e01-62ba-4842-93fa-2a537718983c', '35417e01-95d1-4c14-998c-ba686794cf3d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] Created reservations ['fd6eaa7a-9eb9-4397-b3c0-a91948c0a5a2', '862bf422-2c38-4ff1-902b-8e04985eee92', 'cc9e0c57-e31b-4e71-aa1c-2c7f070c17d2', '2f63800f-29df-4ccf-9869-a66389553883'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-fd735a91-9d6b-421a-a699-3784d7ae6f5f tempest-GroupSnapshotsTest-481713576 None] group_snapshot 5afb5f52-9a25-48f1-b395-fab1af23c5ed: deleted successfully Aug 28 16:17:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e2ec2a-e2db-4c2f-a563-e2c3cdcc1a8d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:51 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 Aug 28 16:17:51 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:51 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864" returned: 0 in 0.915s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:52 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864 Aug 28 16:17:52 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:52 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-48ef1da0-def5-46cc-94eb-e7008bd06864" returned: 0 in 0.732s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-48ef1da0-def5-46cc-94eb-e7008bd06864" released by "delete_volume" :: held 1.801s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29fb076-1a5a-4ccf-988f-a6adb1dc6cca]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:17:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:53 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 Aug 28 16:17:53 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:53 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264" returned: 0 in 0.649s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:53 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264 Aug 28 16:17:53 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:54 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5892dc49-7f9e-4c77-9c5c-49eac1352264" returned: 0 in 0.591s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-5892dc49-7f9e-4c77-9c5c-49eac1352264" released by "delete_volume" :: held 1.400s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:17:54 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['babad002-75c5-4a28-b22c-b85f026fa2b5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:54 devstack cinder-volume[86193]: WARNING cinder.quota [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-769434309 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-769434309, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:17:54 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['6c109341-df0c-41cc-af62-b7bcd8181532', 'bbff7628-b4ed-4e44-a7fd-c2021e952204', '75976a24-38b2-4a34-b1c0-c63e1d24b967', '5b7cc7fd-5d1e-46c5-b853-e4b293acd36f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:54 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['86d0d8a1-addf-43c8-a7b3-2708f158d2d1', '0273300b-a862-4da3-823f-db600a267091', '6e964df4-2463-4860-a0f8-76d6e42fae73', '81efb701-4d66-4e4e-8d90-b23ae6e76389'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:55 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:17:55 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:17:55 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.412s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:17:55 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:17:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-17019660-b9f9-4b49-a795-9efdf73830a1 tempest-GroupSnapshotsTest-481713576 None] Delete group completed successfully. Aug 28 16:17:57 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=93,cinder:SELECT=100,cinder:INSERT=25,cinder:DELETE=3 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:17:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b19ae432-2ae3-443b-8702-1637df39ec67 tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1539354922: creating Aug 28 16:17:57 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=98,cinder:UPDATE=89,cinder:INSERT=17,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:17:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b19ae432-2ae3-443b-8702-1637df39ec67 tempest-GroupSnapshotsTest-481713576 None] Group tempest-GroupSnapshotsTest-Group-1539354922: created successfully Aug 28 16:17:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b19ae432-2ae3-443b-8702-1637df39ec67 tempest-GroupSnapshotsTest-481713576 None] Create group completed successfully. Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Flow 'volume_create_manager' (464ba2f8-14bf-4667-9763-6ec1631c0793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4f3f04-cf14-4f11-9a05-103c89e53587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4f3f04-cf14-4f11-9a05-103c89e53587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-755618829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598d15bd-5492-4827-a4b2-006d0874cf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4730a9077c459bbe5ce5df4bc57839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:59Z,use_quota=True,user_id='cec3b5b60b89407c9ed18bf1c2a236ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3256669-c616-43a8-8b22-186e382b32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3256669-c616-43a8-8b22-186e382b32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632bdc5a-259e-49d2-9f6a-c2dc8c6a0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632bdc5a-259e-49d2-9f6a-c2dc8c6a0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598d15bd-5492-4827-a4b2-006d0874cf84', 'volume_name': 'volume-598d15bd-5492-4827-a4b2-006d0874cf84', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5bd19b-b7e9-4931-bc9e-f451111ce7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5bd19b-b7e9-4931-bc9e-f451111ce7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ad7ef-6ecf-40b9-9713-8f8540c035a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:17:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Volume 598d15bd-5492-4827-a4b2-006d0874cf84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598d15bd-5492-4827-a4b2-006d0874cf84', 'volume_size': 1} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-755618829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598d15bd-5492-4827-a4b2-006d0874cf84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4730a9077c459bbe5ce5df4bc57839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:17:59Z,use_quota=True,user_id='cec3b5b60b89407c9ed18bf1c2a236ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Creating volume 598d15bd-5492-4827-a4b2-006d0874cf84 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:17:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:17:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:17:59 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 1073741824 Aug 28 16:17:59 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:00 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 1073741824" returned: 0 in 1.222s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (7b504bf7-be57-4b18-bdaa-17945e51e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f475693a-f7c6-4a3c-a6f6-94bd0b65d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f475693a-f7c6-4a3c-a6f6-94bd0b65d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960838041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fca25e8-0b2d-49c4-a483-a77e3392cb87,host='devstack@QuobyteHD#QuobyteHD',id=493f390e-a39c-41a8-8ef7-bce7071935d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:00Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5517ed4-cdff-4e2a-a18d-6133bc3f003e),volume_type_id=a5517ed4-cdff-4e2a-a18d-6133bc3f003e)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4ea96a-efb9-41fa-88ce-da92cdb9f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4ea96a-efb9-41fa-88ce-da92cdb9f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bd2d57-e0f8-4784-bb7e-7bbe8006209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bd2d57-e0f8-4784-bb7e-7bbe8006209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493f390e-a39c-41a8-8ef7-bce7071935d6', 'volume_name': 'volume-493f390e-a39c-41a8-8ef7-bce7071935d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcac1dd-dd23-4e0e-9b74-0394de597e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcac1dd-dd23-4e0e-9b74-0394de597e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ade1356-e80a-4eab-b2f2-c48048b09f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Volume 493f390e-a39c-41a8-8ef7-bce7071935d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493f390e-a39c-41a8-8ef7-bce7071935d6', 'volume_size': 1} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:00 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 Aug 28 16:18:00 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:00 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84" returned: 0 in 0.408s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fca25e8-0b2d-49c4-a483-a77e3392cb87,created_at=2026-08-28T14:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960838041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fca25e8-0b2d-49c4-a483-a77e3392cb87,host='devstack@QuobyteHD#QuobyteHD',id=493f390e-a39c-41a8-8ef7-bce7071935d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605c12c0bb184f94bad6983068aca838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:00Z,use_quota=True,user_id='8b0a860f17f04d259c2584661d04888b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5517ed4-cdff-4e2a-a18d-6133bc3f003e),volume_type_id=a5517ed4-cdff-4e2a-a18d-6133bc3f003e)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Creating volume 493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:18:00 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ad7ef-6ecf-40b9-9713-8f8540c035a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598d15bd-5492-4827-a4b2-006d0874cf84', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 1073741824 Aug 28 16:18:00 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a38fb-41db-4588-9dda-7a5f33e3a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Volume volume-598d15bd-5492-4827-a4b2-006d0874cf84 (598d15bd-5492-4827-a4b2-006d0874cf84): created successfully Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a38fb-41db-4588-9dda-7a5f33e3a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Flow 'volume_create_manager' (464ba2f8-14bf-4667-9763-6ec1631c0793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-af2d3281-144d-4354-ad99-5adfe0d9a3a3 tempest-VolumesAdminNegativeTest-1408966759 None] Created volume successfully. Aug 28 16:18:01 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 1073741824" returned: 0 in 0.775s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:01 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 Aug 28 16:18:01 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:02 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ade1356-e80a-4eab-b2f2-c48048b09f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493f390e-a39c-41a8-8ef7-bce7071935d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dd1078-d99c-4e98-a865-e483db4e8144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Volume volume-493f390e-a39c-41a8-8ef7-bce7071935d6 (493f390e-a39c-41a8-8ef7-bce7071935d6): created successfully Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dd1078-d99c-4e98-a865-e483db4e8144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Flow 'volume_create_manager' (7b504bf7-be57-4b18-bdaa-17945e51e116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-46ecac4c-12ee-40a8-8605-021c77950429 tempest-GroupSnapshotsTest-481713576 None] Created volume successfully. Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Acquiring lock "cinder-598d15bd-5492-4827-a4b2-006d0874cf84-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "cinder-598d15bd-5492-4827-a4b2-006d0874cf84-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Acquiring lock "cinder-quobyte-598d15bd-5492-4827-a4b2-006d0874cf84" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "cinder-quobyte-598d15bd-5492-4827-a4b2-006d0874cf84" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fe4ea-0421-43e4-9745-dea5ed83be77]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] GroupSnapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: creating. Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Group snapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: creating. {{(pid=86193) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Creating offline snapshot 17a88204-a92a-4e05-8081-d1d8311f939a of volume 493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:18:03 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 Aug 28 16:18:03 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b09173b-b6aa-44a3-a4f1-3d3583bc4e79]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:03 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 Aug 28 16:18:03 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:04 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84" returned: 0 in 0.630s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:04 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84 Aug 28 16:18:04 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:04 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6" returned: 0 in 0.738s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:04 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a 1G Aug 28 16:18:04 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:04 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-598d15bd-5492-4827-a4b2-006d0874cf84" returned: 0 in 0.477s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "cinder-quobyte-598d15bd-5492-4827-a4b2-006d0874cf84" released by "delete_volume" :: held 1.229s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Created reservations ['3fbdc5b7-0158-4d2f-a84b-da736e9977b8', '53c70f0d-7745-4d74-81d6-a66edc4bbfa5', '4daa93d3-d65f-40d6-83e6-1b881b7d2045', 'f15578a0-1135-4d4f-922a-a7db4ab93493'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:04 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:18:04 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:05 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a 1G" returned: 0 in 0.903s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493f390e-a39c-41a8-8ef7-bce7071935d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:05 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493f390e-a39c-41a8-8ef7-bce7071935d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a Aug 28 16:18:05 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:05 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.540s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:18:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Deleted volume successfully. Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56914a2b-27d6-45dd-8f88-0b34b4db095e tempest-VolumesAdminNegativeTest-1408966759 None] Lock "cinder-598d15bd-5492-4827-a4b2-006d0874cf84-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:05 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493f390e-a39c-41a8-8ef7-bce7071935d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a" returned: 0 in 0.591s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:05 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:18:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:05 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a Aug 28 16:18:05 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:06 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a" returned: 0 in 0.450s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:06 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info Aug 28 16:18:06 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:06 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info" returned: 0 in 0.625s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:06 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:18:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:06 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info Aug 28 16:18:06 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:07 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.info" returned: 0 in 0.489s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.960s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d93ecb12-86d9-4369-a3b5-a8cda1487fbd tempest-GroupSnapshotsTest-481713576 None] group_snapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: created successfully Aug 28 16:18:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] group_snapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: deleting Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] group_snapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: deleting {{(pid=86193) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-17a88204-a92a-4e05-8081-d1d8311f939a" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-17a88204-a92a-4e05-8081-d1d8311f939a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Deleting offline snapshot 17a88204-a92a-4e05-8081-d1d8311f939a of volume 493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] snapshot_file for this snap is: volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e142076e-2d95-43f5-8b3f-d88084e9a494]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:08 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a Aug 28 16:18:08 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:09 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a" returned: 0 in 0.620s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493f390e-a39c-41a8-8ef7-bce7071935d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f9a08-308c-4be3-96df-657af9c63b4c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:09 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 Aug 28 16:18:09 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:09 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6" returned: 0 in 0.480s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:09 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a Aug 28 16:18:09 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:10 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a" returned: 0 in 0.621s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:10 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a Aug 28 16:18:10 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:10 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6.17a88204-a92a-4e05-8081-d1d8311f939a" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-17a88204-a92a-4e05-8081-d1d8311f939a" released by "_delete_snapshot" :: held 2.306s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" released by "delete_snapshot" :: held 2.368s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:10 devstack cinder-volume[86193]: WARNING cinder.quota [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1561149148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1561149148, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:10 devstack cinder-volume[86193]: WARNING cinder.quota [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1561149148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1561149148, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] Created reservations ['4a49b94d-1865-42d1-bc20-1c2ebfb0eb69', 'ad23327d-b943-408c-a641-50956bf20917', '9d6ebb5f-da63-4232-873e-cd096e023936', '4335fdca-6dc2-4f46-b821-598082c43253'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e47b4d53-8803-465c-97d5-fcba1afb4244 tempest-GroupSnapshotsTest-481713576 None] group_snapshot 4c03fd32-53a3-442f-93df-cc94a4d3d57c: deleted successfully Aug 28 16:18:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[242db10b-0dff-4d0d-bd81-7fa8bd9b2320]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:12 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 Aug 28 16:18:12 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:13 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6" returned: 0 in 0.813s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:13 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6 Aug 28 16:18:13 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:13 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-493f390e-a39c-41a8-8ef7-bce7071935d6" returned: 0 in 0.379s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Lock "cinder-quobyte-493f390e-a39c-41a8-8ef7-bce7071935d6" released by "delete_volume" :: held 1.306s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Created reservations ['21528c85-a910-492b-b4ee-92f8ed689a5e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:13 devstack cinder-volume[86193]: WARNING cinder.quota [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1561149148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1561149148, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Created reservations ['ba6471ec-fd07-4d46-b14b-46dd00008f6e', '1e73d9b0-68af-4f5d-8874-77bd67bdf053', '1fcd3824-2d7c-441b-b986-4ee48490474c', '8e569464-163d-4583-8201-94e8dd7ee401'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:14 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:18:14 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:14 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:14 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:18:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f18db5e1-c050-4448-a387-3f36ba6bd41a tempest-GroupSnapshotsTest-481713576 None] Delete group completed successfully. Aug 28 16:18:23 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=28,cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:18:23 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=28,cinder:SELECT=33,cinder:DELETE=1,cinder:INSERT=8 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:18:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-88470e9b-9312-4dcd-9bc5-370a608d4b5c tempest-GroupSnapshotsV319Test-367396616 None] Group tempest-GroupSnapshotsV319Test-Group-2114707569: creating Aug 28 16:18:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-88470e9b-9312-4dcd-9bc5-370a608d4b5c tempest-GroupSnapshotsV319Test-367396616 None] Group tempest-GroupSnapshotsV319Test-Group-2114707569: created successfully Aug 28 16:18:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-88470e9b-9312-4dcd-9bc5-370a608d4b5c tempest-GroupSnapshotsV319Test-367396616 None] Create group completed successfully. Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Flow 'volume_create_manager' (29c46616-cab8-4857-af30-0888424b994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73765f99-36a7-4a6b-abbf-b0b4f14b71c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73765f99-36a7-4a6b-abbf-b0b4f14b71c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953900403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f8a724d-81dd-4436-b18e-cfcc32cc64e0,host='devstack@QuobyteHD#QuobyteHD',id=62c396dd-6661-484d-bbc8-32a1fb6ae87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bed6f5fb6f4173b727f9aad7d1b84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:27Z,use_quota=True,user_id='5fac3a5c1dfa46ada57393ecbef15542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ddd7c5-ea95-4ed4-b942-edc8c0c7d25f),volume_type_id=26ddd7c5-ea95-4ed4-b942-edc8c0c7d25f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b72c72-b1ba-4f2c-9dc4-b7ea10b8a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b72c72-b1ba-4f2c-9dc4-b7ea10b8a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca604070-482c-402b-8c46-7a778ed46192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca604070-482c-402b-8c46-7a778ed46192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c396dd-6661-484d-bbc8-32a1fb6ae87a', 'volume_name': 'volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b039f90c-90aa-41c5-8aeb-3024727f112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b039f90c-90aa-41c5-8aeb-3024727f112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf2acaa-30cd-4f1d-9794-13a36b26a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Volume 62c396dd-6661-484d-bbc8-32a1fb6ae87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a', 'volume_size': 1} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f8a724d-81dd-4436-b18e-cfcc32cc64e0,created_at=2026-08-28T14:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953900403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f8a724d-81dd-4436-b18e-cfcc32cc64e0,host='devstack@QuobyteHD#QuobyteHD',id=62c396dd-6661-484d-bbc8-32a1fb6ae87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bed6f5fb6f4173b727f9aad7d1b84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:27Z,use_quota=True,user_id='5fac3a5c1dfa46ada57393ecbef15542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26ddd7c5-ea95-4ed4-b942-edc8c0c7d25f),volume_type_id=26ddd7c5-ea95-4ed4-b942-edc8c0c7d25f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Creating volume 62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:18:27 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:18:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:27 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a 1073741824 Aug 28 16:18:27 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:28 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a 1073741824" returned: 0 in 0.696s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:28 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a Aug 28 16:18:28 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:28 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf2acaa-30cd-4f1d-9794-13a36b26a599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde77ce9-a5b1-4e93-8e23-17d7f3546270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Volume volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a (62c396dd-6661-484d-bbc8-32a1fb6ae87a): created successfully Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde77ce9-a5b1-4e93-8e23-17d7f3546270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Flow 'volume_create_manager' (29c46616-cab8-4857-af30-0888424b994b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6108a475-d788-40d2-b640-c4ae28fcb8cc tempest-GroupSnapshotsV319Test-367396616 None] Created volume successfully. Aug 28 16:18:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] GroupSnapshot 1181f965-7909-4074-80e0-fc2cbf92121b: creating. Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Group snapshot 1181f965-7909-4074-80e0-fc2cbf92121b: creating. {{(pid=86193) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Creating offline snapshot ed87e15c-bf65-40bd-a23f-8227a4df2490 of volume 62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f07e4d-1bb7-4dc8-ae41-2e73d2d76c6b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:30 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a Aug 28 16:18:30 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:30 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a" returned: 0 in 0.568s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:30 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 1G Aug 28 16:18:30 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:31 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 1G" returned: 0 in 0.573s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:31 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 Aug 28 16:18:31 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:31 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:18:31 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:31 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.387s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 8 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:18:31 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490" returned: 0 in 0.601s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:31 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:18:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:31 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 Aug 28 16:18:31 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:32 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490" returned: 0 in 0.475s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:32 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info Aug 28 16:18:32 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:32 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:32 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:18:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:32 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info Aug 28 16:18:32 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:33 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.info" returned: 0 in 0.463s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-60bb10b0-50b0-4fe7-93f9-e1c11bafe204 tempest-GroupSnapshotsV319Test-367396616 None] group_snapshot 1181f965-7909-4074-80e0-fc2cbf92121b: created successfully Aug 28 16:18:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] group_snapshot 1181f965-7909-4074-80e0-fc2cbf92121b: deleting Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] group_snapshot 1181f965-7909-4074-80e0-fc2cbf92121b: deleting {{(pid=86193) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "cinder-quobyte-ed87e15c-bf65-40bd-a23f-8227a4df2490" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-ed87e15c-bf65-40bd-a23f-8227a4df2490" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Deleting offline snapshot ed87e15c-bf65-40bd-a23f-8227a4df2490 of volume 62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] snapshot_file for this snap is: volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7fb6b3-3468-4338-8545-c5a8f35aa20d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:35 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 Aug 28 16:18:35 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:36 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490" returned: 0 in 0.588s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47cb73a-58c4-4be5-9754-2da1a2f0ab2b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:36 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a Aug 28 16:18:36 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:36 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a" returned: 0 in 0.602s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:36 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 Aug 28 16:18:36 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:37 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490" returned: 0 in 0.576s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:37 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490 Aug 28 16:18:37 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:37 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a.ed87e15c-bf65-40bd-a23f-8227a4df2490" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-ed87e15c-bf65-40bd-a23f-8227a4df2490" released by "_delete_snapshot" :: held 2.333s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" released by "delete_snapshot" :: held 2.381s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:37 devstack cinder-volume[86193]: WARNING cinder.quota [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1786388069 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1786388069, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:37 devstack cinder-volume[86193]: WARNING cinder.quota [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1786388069 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1786388069, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] Created reservations ['67f40573-44e8-4d93-8f92-be9016af05de', 'c5f27f87-3035-475d-80e5-03ef1f103d52', 'd18cf3eb-2720-4422-9342-e84ffdca0300', 'bd1e029d-4a7c-4252-9ce7-6ec37d855a70'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-51fe4b25-386f-4cae-aa97-5e78f45d23fe tempest-GroupSnapshotsV319Test-367396616 None] group_snapshot 1181f965-7909-4074-80e0-fc2cbf92121b: deleted successfully Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" acquired by "delete_volume" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19a582c-d4f6-4680-ac17-9fc02a9f3a3d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (05e50f04-4176-429f-b012-95893c2ef2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb712de-f289-4900-a33d-ed1bdece5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb712de-f289-4900-a33d-ed1bdece5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958872349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b387a20-811d-4eb1-88f1-0a4102070da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:39Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421d9811-2e15-4613-9613-1dc7afb855af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421d9811-2e15-4613-9613-1dc7afb855af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53df97c-2ac9-4398-bf99-c068a64828eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53df97c-2ac9-4398-bf99-c068a64828eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b387a20-811d-4eb1-88f1-0a4102070da1', 'volume_name': 'volume-9b387a20-811d-4eb1-88f1-0a4102070da1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f633d77-bd52-4269-a3c3-19dcb6e645f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f633d77-bd52-4269-a3c3-19dcb6e645f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa878852-0452-4b98-b9c1-ad6475f8e23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:39 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Volume 9b387a20-811d-4eb1-88f1-0a4102070da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b387a20-811d-4eb1-88f1-0a4102070da1', 'volume_size': 1} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958872349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b387a20-811d-4eb1-88f1-0a4102070da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:18:39Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Creating volume 9b387a20-811d-4eb1-88f1-0a4102070da1 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:18:39 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:18:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:39 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a Aug 28 16:18:39 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:39 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 1073741824 Aug 28 16:18:39 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:40 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a" returned: 0 in 0.576s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:40 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a Aug 28 16:18:40 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:40 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 1073741824" returned: 0 in 0.612s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:40 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 Aug 28 16:18:40 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:40 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-62c396dd-6661-484d-bbc8-32a1fb6ae87a" returned: 0 in 0.398s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Lock "cinder-quobyte-62c396dd-6661-484d-bbc8-32a1fb6ae87a" released by "delete_volume" :: held 1.077s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Created reservations ['1825a91d-d339-48ed-81ed-69e8989cd349'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:40 devstack cinder-volume[86193]: WARNING cinder.quota [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1786388069 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1786388069, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Created reservations ['f107c44f-3d4f-4227-a0e5-0433f9ee8b1d', '7e5861f7-7d0e-4cc7-88e5-569217cc3342', '95657eaa-1d3f-4701-bf21-2fca4c230f07', 'cdb955b3-8251-494d-a3d6-993458c79056'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:18:40 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1" returned: 0 in 0.520s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa878852-0452-4b98-b9c1-ad6475f8e23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b387a20-811d-4eb1-88f1-0a4102070da1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:40 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8953291-0334-481f-b177-70b6c1a3ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:18:40 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:18:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Volume volume-9b387a20-811d-4eb1-88f1-0a4102070da1 (9b387a20-811d-4eb1-88f1-0a4102070da1): created successfully Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8953291-0334-481f-b177-70b6c1a3ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:18:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (05e50f04-4176-429f-b012-95893c2ef2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:18:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-452571e0-6280-40a0-a88f-09272c79db5f tempest-AttachVolumeNegativeTest-149611832 None] Created volume successfully. Aug 28 16:18:41 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Aug 28 16:18:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.480s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:18:41 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:18:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bc37a04b-15c6-48f8-9e20-c2a5295d1192 tempest-GroupSnapshotsV319Test-367396616 None] Delete group completed successfully. Aug 28 16:18:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ff306269-ba87-4b8c-b5b9-11e9856083ef req-09f54f0f-4268-4044-9f9f-1a350fcf1bd0 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:18:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ff306269-ba87-4b8c-b5b9-11e9856083ef req-09f54f0f-4268-4044-9f9f-1a350fcf1bd0 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:18:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ff306269-ba87-4b8c-b5b9-11e9856083ef req-09f54f0f-4268-4044-9f9f-1a350fcf1bd0 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:18:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-ff306269-ba87-4b8c-b5b9-11e9856083ef req-09f54f0f-4268-4044-9f9f-1a350fcf1bd0 tempest-AttachVolumeNegativeTest-149611832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-9b387a20-811d-4eb1-88f1-0a4102070da1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17e13aca-185b-47c0-80ff-df5abe830a89', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:18:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-ff306269-ba87-4b8c-b5b9-11e9856083ef req-09f54f0f-4268-4044-9f9f-1a350fcf1bd0 tempest-AttachVolumeNegativeTest-149611832 None] attachment_update completed successfully. Aug 28 16:18:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-d752b55e-45b1-4ea3-a20d-9f7a0388e1f8 req-abe71316-9260-4d78-8d09-0fc80662c97a tempest-AttachVolumeNegativeTest-149611832 None] Terminate volume connection completed successfully. Aug 28 16:18:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-d752b55e-45b1-4ea3-a20d-9f7a0388e1f8 req-abe71316-9260-4d78-8d09-0fc80662c97a tempest-AttachVolumeNegativeTest-149611832 None] Deleting attachment 17e13aca-185b-47c0-80ff-df5abe830a89. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:18:52 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=25,cinder:SELECT=35,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:18:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Flow 'volume_create_manager' (b352f86d-945e-44d9-98f1-f079a54ec3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4713cb-b7d8-41e6-a254-d3db86538f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4713cb-b7d8-41e6-a254-d3db86538f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1493192868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545ef7c1-35ec-4326-9704-5c55e352505a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4283df9ac049b69e6bb3d2a5983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:02Z,use_quota=True,user_id='ec9b5cd52b70456497b85c04487e4db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c26f6d-fd8c-4b7d-b9fd-b52784ce1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c26f6d-fd8c-4b7d-b9fd-b52784ce1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8304b3d5-9b96-48a8-a635-fc8a1d9b410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8304b3d5-9b96-48a8-a635-fc8a1d9b410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545ef7c1-35ec-4326-9704-5c55e352505a', 'volume_name': 'volume-545ef7c1-35ec-4326-9704-5c55e352505a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582e2733-ef73-4c4b-bc8d-782367c07617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582e2733-ef73-4c4b-bc8d-782367c07617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129c901c-9f0e-4e62-b93b-2b4414c0d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Volume 545ef7c1-35ec-4326-9704-5c55e352505a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545ef7c1-35ec-4326-9704-5c55e352505a', 'volume_size': 1} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1493192868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545ef7c1-35ec-4326-9704-5c55e352505a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4283df9ac049b69e6bb3d2a5983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:02Z,use_quota=True,user_id='ec9b5cd52b70456497b85c04487e4db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Creating volume 545ef7c1-35ec-4326-9704-5c55e352505a {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:19:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:19:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:02 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a 1073741824 Aug 28 16:19:02 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:03 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a 1073741824" returned: 0 in 0.904s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:03 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a Aug 28 16:19:03 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:03 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129c901c-9f0e-4e62-b93b-2b4414c0d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545ef7c1-35ec-4326-9704-5c55e352505a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a843b9-c687-4eaf-8465-944b7d3b7fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Volume volume-545ef7c1-35ec-4326-9704-5c55e352505a (545ef7c1-35ec-4326-9704-5c55e352505a): created successfully Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a843b9-c687-4eaf-8465-944b7d3b7fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Flow 'volume_create_manager' (b352f86d-945e-44d9-98f1-f079a54ec3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-874eff47-ba1f-407d-9855-367c670d5456 tempest-ServerActionsTestOtherA-385066909 None] Created volume successfully. Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Flow 'volume_create_manager' (b6bcd740-113b-4cde-a61c-c9ab3d20a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea50f7d-4aaa-459a-b071-0818e018e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea50f7d-4aaa-459a-b071-0818e018e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2089755101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff591b-ed89-4c25-b62c-c8b092b57288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c477b917ea412b912147b82720d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:06Z,use_quota=True,user_id='b390e1f3bac242a78cd0e09767133032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c020ae6-a710-4e91-bc9f-2a2437cdc4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c020ae6-a710-4e91-bc9f-2a2437cdc4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c510fac-4a5b-43d4-8171-352f124ca0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c510fac-4a5b-43d4-8171-352f124ca0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ff591b-ed89-4c25-b62c-c8b092b57288', 'volume_name': 'volume-37ff591b-ed89-4c25-b62c-c8b092b57288', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a156107-e430-4612-91d0-2a77a12c7ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a156107-e430-4612-91d0-2a77a12c7ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80447c62-c27a-4fd3-95b7-50355206da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Volume 37ff591b-ed89-4c25-b62c-c8b092b57288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ff591b-ed89-4c25-b62c-c8b092b57288', 'volume_size': 1} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2089755101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ff591b-ed89-4c25-b62c-c8b092b57288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c477b917ea412b912147b82720d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:06Z,use_quota=True,user_id='b390e1f3bac242a78cd0e09767133032',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Creating volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:19:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:19:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:05 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 1073741824 Aug 28 16:19:05 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:06 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 1073741824" returned: 0 in 0.769s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:06 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 Aug 28 16:19:06 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:07 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288" returned: 0 in 0.415s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80447c62-c27a-4fd3-95b7-50355206da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ff591b-ed89-4c25-b62c-c8b092b57288', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc89249-2883-4d6e-be68-9d8f9a2c0d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Volume volume-37ff591b-ed89-4c25-b62c-c8b092b57288 (37ff591b-ed89-4c25-b62c-c8b092b57288): created successfully Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc89249-2883-4d6e-be68-9d8f9a2c0d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Flow 'volume_create_manager' (b6bcd740-113b-4cde-a61c-c9ab3d20a134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-66b3f91b-076f-489d-bb3b-a7264236940d tempest-SnapshotsActionsTest-844201184 None] Created volume successfully. Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Creating offline snapshot 6f698346-24fc-4316-aaba-bcef1c8042a4 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99dda08-539a-44be-bd04-48e9f6a42415]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:08 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 Aug 28 16:19:08 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:08 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288" returned: 0 in 0.447s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:08 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 1G Aug 28 16:19:08 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:09 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 1G" returned: 0 in 0.776s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:09 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:09 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:09 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.584s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:10 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 is being set with open permissions: ugo+rw Aug 28 16:19:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:10 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:10 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:10 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:10 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info Aug 28 16:19:10 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:11 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info" returned: 0 in 0.475s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:11 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info is being set with open permissions: ugo+rw Aug 28 16:19:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:11 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info Aug 28 16:19:11 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:12 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.info" returned: 0 in 1.266s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e7064432-cea1-45cf-b1ba-3c74dde526f2 tempest-SnapshotsActionsTest-844201184 None] Create snapshot completed successfully Aug 28 16:19:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Creating offline snapshot 4946b34c-e495-4d9e-90fd-032255df363e of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:19:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a6041-f4ae-40e5-9fd4-531f1d69df29]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:14 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:14 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:15 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.882s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:15 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e 1G Aug 28 16:19:15 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:16 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e 1G" returned: 0 in 1.112s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:16 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e Aug 28 16:19:16 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:17 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e" returned: 0 in 0.865s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:17 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e is being set with open permissions: ugo+rw Aug 28 16:19:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:17 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e Aug 28 16:19:17 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:18 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e" returned: 0 in 0.686s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.914s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-da61ad13-0028-4863-a348-d6951187623e tempest-SnapshotsActionsTest-844201184 None] Create snapshot completed successfully Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-4946b34c-e495-4d9e-90fd-032255df363e-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-4946b34c-e495-4d9e-90fd-032255df363e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-4946b34c-e495-4d9e-90fd-032255df363e" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-4946b34c-e495-4d9e-90fd-032255df363e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Deleting offline snapshot 4946b34c-e495-4d9e-90fd-032255df363e of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] snapshot_file for this snap is: volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[739baf52-e837-4fc4-bd81-ca3297da0934]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:20 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e Aug 28 16:19:20 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:20 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e" returned: 0 in 1.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c681f16-2288-4cd5-83c0-4c04e323be62]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:21 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:21 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:21 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.787s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:21 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e Aug 28 16:19:21 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:22 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e" returned: 0 in 1.105s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:23 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e Aug 28 16:19:23 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:23 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.4946b34c-e495-4d9e-90fd-032255df363e" returned: 0 in 0.687s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-4946b34c-e495-4d9e-90fd-032255df363e" released by "_delete_snapshot" :: held 4.084s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_snapshot" :: held 4.157s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:23 devstack cinder-volume[86193]: WARNING cinder.quota [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:19:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Created reservations ['e1589203-880e-4aba-968a-57c1448760ae', '07147b51-9965-413e-96eb-ba9d076a30f2', 'd8b5a27d-99ba-49bd-80cf-eeb64aaaa089', '873f3de0-f3f9-4638-91ea-cb8c221a577d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:23 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Delete snapshot completed successfully. Aug 28 16:19:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-12f16ced-ed95-4d19-afe9-f86cd3a71023 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-4946b34c-e495-4d9e-90fd-032255df363e-delete_snapshot" released by "delete_snapshot" :: held 4.510s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Creating offline snapshot 73c28c84-a4ec-49e5-8500-eb05eb48ed4a of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:19:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd0a5ea-db9b-4d8f-b95f-6d4937b421ca]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:26 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:26 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:27 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 1.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:27 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a 1G Aug 28 16:19:27 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:29 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a 1G" returned: 0 in 1.526s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:29 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a Aug 28 16:19:29 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:29 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a" returned: 0 in 0.453s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:29 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a is being set with open permissions: ugo+rw Aug 28 16:19:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:29 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a Aug 28 16:19:29 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:30 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a" returned: 0 in 0.522s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9c20399a-d70d-4e8c-88a6-275ce6070bee tempest-SnapshotsActionsTest-844201184 None] Create snapshot completed successfully Aug 28 16:19:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-73c28c84-a4ec-49e5-8500-eb05eb48ed4a-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-73c28c84-a4ec-49e5-8500-eb05eb48ed4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-73c28c84-a4ec-49e5-8500-eb05eb48ed4a" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-73c28c84-a4ec-49e5-8500-eb05eb48ed4a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Deleting offline snapshot 73c28c84-a4ec-49e5-8500-eb05eb48ed4a of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] snapshot_file for this snap is: volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b6c2b2-e109-4e4a-bfc0-f627b1ef9231]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:19:31 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a Aug 28 16:19:31 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:31 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:19:31 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:32 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a" returned: 0 in 0.843s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1325dc1f-762a-42c1-b983-5b6da6f30a9c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:32 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.815s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 8 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:19:32 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:32 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:32 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.654s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:32 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a Aug 28 16:19:32 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Flow 'volume_create_manager' (0771ca87-9289-42b2-aff4-98dd5ffd060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a9540b-2b16-47e8-b9c0-066e709e8cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:33 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a" returned: 0 in 1.005s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a9540b-2b16-47e8-b9c0-066e709e8cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1624107328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c34631b-c692-4c1b-8315-1d5cf2b91e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467d401003748dd84f637eab04c83ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:34Z,use_quota=True,user_id='55126fb7335d497cab17ca71e91c51b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63f9060-2e59-443e-900e-be75215580d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63f9060-2e59-443e-900e-be75215580d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:33 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f304e8d6-30d4-4b65-b0ed-f43de05cf336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:33 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f304e8d6-30d4-4b65-b0ed-f43de05cf336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c34631b-c692-4c1b-8315-1d5cf2b91e91', 'volume_name': 'volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141cbc25-6e67-44f6-ac38-f93a1b075eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141cbc25-6e67-44f6-ac38-f93a1b075eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3405cd-d1c8-4003-b77f-91e26a6d7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:33 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Volume 7c34631b-c692-4c1b-8315-1d5cf2b91e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91', 'volume_size': 1} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1624107328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c34631b-c692-4c1b-8315-1d5cf2b91e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467d401003748dd84f637eab04c83ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:34Z,use_quota=True,user_id='55126fb7335d497cab17ca71e91c51b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Creating volume 7c34631b-c692-4c1b-8315-1d5cf2b91e91 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:19:33 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:19:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:33 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 1073741824 Aug 28 16:19:33 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:34 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.73c28c84-a4ec-49e5-8500-eb05eb48ed4a" returned: 0 in 0.618s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-73c28c84-a4ec-49e5-8500-eb05eb48ed4a" released by "_delete_snapshot" :: held 3.357s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_snapshot" :: held 3.407s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Created reservations ['f45e4329-72f5-4676-b1a6-80b8e38c1d62', '2f262d0b-8f4d-4754-a6f1-a877921c5176', '07faed98-76b8-4fab-8151-111992a99896', 'f2677f78-d50e-40b4-8668-2cdc1270a2b8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Delete snapshot completed successfully. Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6db43153-3968-4883-a196-c813a0549bf8 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-73c28c84-a4ec-49e5-8500-eb05eb48ed4a-delete_snapshot" released by "delete_snapshot" :: held 3.797s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:34 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 1073741824" returned: 0 in 1.000s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:34 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 Aug 28 16:19:34 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:35 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91" returned: 0 in 0.400s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3405cd-d1c8-4003-b77f-91e26a6d7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ba7428-94f5-459d-b985-cdb24a41b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:35 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Volume volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 (7c34631b-c692-4c1b-8315-1d5cf2b91e91): created successfully Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ba7428-94f5-459d-b985-cdb24a41b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Flow 'volume_create_manager' (0771ca87-9289-42b2-aff4-98dd5ffd060f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c4429e11-8534-49ea-b00a-59eaaa265aa8 tempest-ServerRescueNegativeTestJSON-965707368 None] Created volume successfully. Aug 28 16:19:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Creating offline snapshot 1aef9520-55a9-4a21-9191-7ebecd87f802 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:19:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[01688620-0881-4059-b924-78affb0b1724]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:36 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:36 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:37 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 1.048s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:37 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 1G Aug 28 16:19:37 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:38 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 1G" returned: 0 in 0.993s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:38 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 Aug 28 16:19:38 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:38 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802" returned: 0 in 0.697s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:38 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 is being set with open permissions: ugo+rw Aug 28 16:19:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:38 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 Aug 28 16:19:38 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:39 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802" returned: 0 in 0.528s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.509s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a0b2caea-33f8-4e55-9a3b-1f0d400e6f1f tempest-SnapshotsActionsTest-844201184 None] Create snapshot completed successfully Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-1aef9520-55a9-4a21-9191-7ebecd87f802-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-1aef9520-55a9-4a21-9191-7ebecd87f802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-1aef9520-55a9-4a21-9191-7ebecd87f802" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-1aef9520-55a9-4a21-9191-7ebecd87f802" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Deleting offline snapshot 1aef9520-55a9-4a21-9191-7ebecd87f802 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] snapshot_file for this snap is: volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4942e-9b34-4294-b28f-9181cf063e99]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:41 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 Aug 28 16:19:41 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:41 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802" returned: 0 in 0.837s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd24b9-4464-4dc2-a467-2c8d6f4d22d5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:41 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:41 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:42 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.496s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:42 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 Aug 28 16:19:42 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:42 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802" returned: 0 in 0.637s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:42 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802 Aug 28 16:19:42 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:43 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.1aef9520-55a9-4a21-9191-7ebecd87f802" returned: 0 in 0.573s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-1aef9520-55a9-4a21-9191-7ebecd87f802" released by "_delete_snapshot" :: held 2.716s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_snapshot" :: held 2.764s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:43 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Created reservations ['82f15f4f-e8c4-43c6-8c9e-e1b289dfe187', 'ffbd65fa-ac2c-49fb-a45a-f841e8429918', '786d338f-2e6f-4ed0-83d7-82c8dee52014', '6a661274-664a-4185-993d-0620a15e0aef'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Delete snapshot completed successfully. Aug 28 16:19:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d23f8667-b2fb-4f05-8d1b-0bcbcd687a63 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-1aef9520-55a9-4a21-9191-7ebecd87f802-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Creating offline snapshot c4998a5e-7011-4268-a724-253b79900593 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:19:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0cb2f-2124-4707-8824-4e1e9eb6c726]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:44 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:44 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:45 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.499s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:45 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 1G Aug 28 16:19:45 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:45 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 1G" returned: 0 in 0.530s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:45 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 Aug 28 16:19:45 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:46 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593" returned: 0 in 0.340s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:46 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 is being set with open permissions: ugo+rw Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:46 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 Aug 28 16:19:46 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:46 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593" returned: 0 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b74e6599-928b-4066-b7b7-75a3e397fbeb tempest-SnapshotsActionsTest-844201184 None] Create snapshot completed successfully Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-c4998a5e-7011-4268-a724-253b79900593-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-c4998a5e-7011-4268-a724-253b79900593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Acquiring lock "cinder-quobyte-c4998a5e-7011-4268-a724-253b79900593" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-c4998a5e-7011-4268-a724-253b79900593" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Deleting offline snapshot c4998a5e-7011-4268-a724-253b79900593 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] snapshot_file for this snap is: volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cf59ba-9662-4cf4-aff3-6bafbff9dc72]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:47 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 Aug 28 16:19:47 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:47 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593" returned: 0 in 0.414s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c024c90-7b23-4a65-bcfc-a78ee8b8491f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:47 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:47 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:47 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.475s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:48 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 Aug 28 16:19:48 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Acquiring lock "cinder-7c34631b-c692-4c1b-8315-1d5cf2b91e91-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "cinder-7c34631b-c692-4c1b-8315-1d5cf2b91e91-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Acquiring lock "cinder-quobyte-7c34631b-c692-4c1b-8315-1d5cf2b91e91" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "cinder-quobyte-7c34631b-c692-4c1b-8315-1d5cf2b91e91" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[893864e4-aa92-4441-9b17-abf125ca180e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:48 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 Aug 28 16:19:48 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:48 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593" returned: 0 in 0.820s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:48 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593 Aug 28 16:19:48 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:49 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.c4998a5e-7011-4268-a724-253b79900593" returned: 0 in 0.412s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:49 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91" returned: 0 in 0.683s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-c4998a5e-7011-4268-a724-253b79900593" released by "_delete_snapshot" :: held 2.275s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_snapshot" :: held 2.315s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:49 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91 Aug 28 16:19:49 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Created reservations ['633f67cb-86f2-4ad9-aa91-a6373fa3102c', '4235869e-c4e4-48f3-a6c3-748807c149e7', 'bba0b833-9632-4267-988b-9379c5f3ea1a', '7a6f7a5a-36b3-4371-ab89-3b15f6a5f612'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Delete snapshot completed successfully. Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2863920-fffb-46c0-b044-5b66f6ea7241 tempest-SnapshotsActionsTest-2033921353 None] Lock "cinder-c4998a5e-7011-4268-a724-253b79900593-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:49 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7c34631b-c692-4c1b-8315-1d5cf2b91e91" returned: 0 in 0.431s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "cinder-quobyte-7c34631b-c692-4c1b-8315-1d5cf2b91e91" released by "delete_volume" :: held 1.178s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Created reservations ['1f0fbcca-610a-4cc2-96f7-8cec31d7d405', 'cbc96e72-c721-47aa-85a9-67e250dabe94', '53b2511d-a1cd-4d59-b2c9-4b735afff3dd', 'c4270bbd-c2ad-4678-9f18-c56171d8ee80'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:49 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:19:49 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:50 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.284s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:19:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Deleted volume successfully. Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3179feec-2c9e-4282-8359-a44069ce3476 tempest-ServerRescueNegativeTestJSON-965707368 None] Lock "cinder-7c34631b-c692-4c1b-8315-1d5cf2b91e91-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "cinder-6f698346-24fc-4316-aaba-bcef1c8042a4-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-6f698346-24fc-4316-aaba-bcef1c8042a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "cinder-quobyte-6f698346-24fc-4316-aaba-bcef1c8042a4" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-6f698346-24fc-4316-aaba-bcef1c8042a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Deleting offline snapshot 6f698346-24fc-4316-aaba-bcef1c8042a4 of volume 37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] snapshot_file for this snap is: volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bd5c8-48cc-4d6b-98a5-0fa1bf0a20b2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:50 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:50 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:51 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.519s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ff591b-ed89-4c25-b62c-c8b092b57288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:19:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7255311c-4335-4045-bce7-554642d332ce]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:51 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 Aug 28 16:19:51 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:52 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288" returned: 0 in 0.772s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:52 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:52 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (7048d6b2-ca79-4e27-bfa8-b43ea18772ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01170fce-f308-47de-84a0-37e1301dc52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01170fce-f308-47de-84a0-37e1301dc52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-109814023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e35d478-7749-47a9-9782-a09c8c2ebe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:52Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affe89de-edf3-450e-8475-2bfc33874414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affe89de-edf3-450e-8475-2bfc33874414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f5030-7293-4610-b9cf-68baa2089548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f4f5030-7293-4610-b9cf-68baa2089548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e35d478-7749-47a9-9782-a09c8c2ebe4a', 'volume_name': 'volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981b5ec0-92a3-4149-bf02-d965549166f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981b5ec0-92a3-4149-bf02-d965549166f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811e4a06-a13b-449e-8017-03284f178fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:52 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Volume 4e35d478-7749-47a9-9782-a09c8c2ebe4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a', 'volume_size': 1} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-109814023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e35d478-7749-47a9-9782-a09c8c2ebe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a9810d190f48d6849d73d6031494ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:19:52Z,use_quota=True,user_id='63d462069694420887094c79199a746e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Creating volume 4e35d478-7749-47a9-9782-a09c8c2ebe4a {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:19:52 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:52 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a 1073741824 Aug 28 16:19:52 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:52 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.669s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:52 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4 Aug 28 16:19:52 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:53 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a 1073741824" returned: 0 in 0.611s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=43,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:53 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a Aug 28 16:19:53 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:53 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288.6f698346-24fc-4316-aaba-bcef1c8042a4" returned: 0 in 0.450s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-6f698346-24fc-4316-aaba-bcef1c8042a4" released by "_delete_snapshot" :: held 2.611s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_snapshot" :: held 2.645s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Created reservations ['6bceeaaa-40ac-40a8-ac94-93d82e6b9325', '1bcead55-2a75-4ba1-a5c6-7b8dc278c346', '17179ee3-3144-4d04-bfb4-21df69647065', '6716108d-729e-4034-9f02-87a87a778955'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Delete snapshot completed successfully. Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cd5d11fc-7a15-4d54-bbea-07833ab8605f tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-6f698346-24fc-4316-aaba-bcef1c8042a4-delete_snapshot" released by "delete_snapshot" :: held 2.902s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:53 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a" returned: 0 in 0.372s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811e4a06-a13b-449e-8017-03284f178fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3b97b0-9c79-40ce-86e5-3ae84d83105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:19:53 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Volume volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a (4e35d478-7749-47a9-9782-a09c8c2ebe4a): created successfully Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3b97b0-9c79-40ce-86e5-3ae84d83105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:19:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Flow 'volume_create_manager' (7048d6b2-ca79-4e27-bfa8-b43ea18772ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:19:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-67293acc-deda-4a53-bd19-4e916374753d tempest-AttachVolumeNegativeTest-149611832 None] Created volume successfully. Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "cinder-37ff591b-ed89-4c25-b62c-c8b092b57288-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-37ff591b-ed89-4c25-b62c-c8b092b57288-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5af4b3-6519-437b-a878-8a90ce9aa4f2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:54 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 Aug 28 16:19:54 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:54 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288" returned: 0 in 0.457s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:55 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288 Aug 28 16:19:55 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:55 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-37ff591b-ed89-4c25-b62c-c8b092b57288" returned: 0 in 0.357s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-quobyte-37ff591b-ed89-4c25-b62c-c8b092b57288" released by "delete_volume" :: held 0.942s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Created reservations ['c96f4041-5112-4a00-878c-bb3ca49683b2', '7fadf347-5358-492a-9d4e-a1115d689cff', '9a218f5d-fdc2-426d-8dcc-05d8e94adbc2', '67e9bcc9-c972-44e9-a010-f5edd87fc5dc'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=60,cinder:INSERT=17,cinder:UPDATE=53,cinder:DELETE=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:19:55 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:19:55 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:19:56 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:19:56 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Deleted volume successfully. Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-169d25b3-fd31-4f7a-b82a-a68c3024e52d req-d4d1a335-80c7-45f3-a9de-6628fbabb4b7 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-169d25b3-fd31-4f7a-b82a-a68c3024e52d req-d4d1a335-80c7-45f3-a9de-6628fbabb4b7 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-16f8adbf-9f83-4e33-873f-99800e98e865 tempest-SnapshotsActionsTest-844201184 None] Lock "cinder-37ff591b-ed89-4c25-b62c-c8b092b57288-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-169d25b3-fd31-4f7a-b82a-a68c3024e52d req-d4d1a335-80c7-45f3-a9de-6628fbabb4b7 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:19:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-169d25b3-fd31-4f7a-b82a-a68c3024e52d req-d4d1a335-80c7-45f3-a9de-6628fbabb4b7 tempest-AttachVolumeNegativeTest-149611832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b59f5a81-496c-4615-9da7-de93101307a1', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:19:56 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-169d25b3-fd31-4f7a-b82a-a68c3024e52d req-d4d1a335-80c7-45f3-a9de-6628fbabb4b7 tempest-AttachVolumeNegativeTest-149611832 None] attachment_update completed successfully. Aug 28 16:20:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-150fa131-683c-42fe-a7de-c1efed6258b8 req-c519eb29-e79e-421e-81fa-26ec5328d886 tempest-AttachVolumeNegativeTest-149611832 None] Terminate volume connection completed successfully. Aug 28 16:20:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-150fa131-683c-42fe-a7de-c1efed6258b8 req-c519eb29-e79e-421e-81fa-26ec5328d886 tempest-AttachVolumeNegativeTest-149611832 None] Deleting attachment b59f5a81-496c-4615-9da7-de93101307a1. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:20:06 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=19 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:20:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-4e35d478-7749-47a9-9782-a09c8c2ebe4a-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-4e35d478-7749-47a9-9782-a09c8c2ebe4a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-quobyte-4e35d478-7749-47a9-9782-a09c8c2ebe4a" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-4e35d478-7749-47a9-9782-a09c8c2ebe4a" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0692b-c236-4f6e-817e-724ab2e27eb5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:07 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a Aug 28 16:20:07 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:07 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:07 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a Aug 28 16:20:07 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:07 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4e35d478-7749-47a9-9782-a09c8c2ebe4a" returned: 0 in 0.329s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-4e35d478-7749-47a9-9782-a09c8c2ebe4a" released by "delete_volume" :: held 0.868s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Created reservations ['04cb6432-9b88-4203-aaa3-a4c22fa5d801', '9487d20e-b7a2-46dd-b8f7-218c3a4c6039', 'c9b1bb9b-2e70-423d-9ee0-3618c9fb289e', '5a3f37e0-8e16-4797-8269-cc8a933a64ba'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:08 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:08 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-9b387a20-811d-4eb1-88f1-0a4102070da1-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-9b387a20-811d-4eb1-88f1-0a4102070da1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:08 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Deleted volume successfully. Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-quobyte-9b387a20-811d-4eb1-88f1-0a4102070da1" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c0dd5e1b-75be-40db-9f1e-63a43f8195b6 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-4e35d478-7749-47a9-9782-a09c8c2ebe4a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-9b387a20-811d-4eb1-88f1-0a4102070da1" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[91839ee1-9085-412e-83ae-5411bb552d5c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:08 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 Aug 28 16:20:08 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:09 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1" returned: 0 in 0.503s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:09 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1 Aug 28 16:20:09 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:09 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b387a20-811d-4eb1-88f1-0a4102070da1" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-9b387a20-811d-4eb1-88f1-0a4102070da1" released by "delete_volume" :: held 0.909s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Created reservations ['3fd0c520-21f4-47b3-87d7-519f47e9adfb', 'ab84cd74-c315-4711-8edf-682b06ff5c72', 'bd018c19-82e6-407c-80e0-6ab01e85e6e9', '3a9e7117-a088-4285-a009-68ea7093bfe8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:09 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:09 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:09 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.269s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:09 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Deleted volume successfully. Aug 28 16:20:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6fdfac02-02bb-4fd4-810a-f030f0134bed tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-9b387a20-811d-4eb1-88f1-0a4102070da1-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-a1cafe9a-426f-4701-b112-0b753fa29a99-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-a1cafe9a-426f-4701-b112-0b753fa29a99-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "cinder-quobyte-a1cafe9a-426f-4701-b112-0b753fa29a99" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-a1cafe9a-426f-4701-b112-0b753fa29a99" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce15a2e-06b4-4053-813c-cb2a35225bc7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:11 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 Aug 28 16:20:11 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:11 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99" returned: 0 in 0.502s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:11 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99 Aug 28 16:20:11 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:12 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a1cafe9a-426f-4701-b112-0b753fa29a99" returned: 0 in 0.545s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-quobyte-a1cafe9a-426f-4701-b112-0b753fa29a99" released by "delete_volume" :: held 1.131s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Created reservations ['f93ef66a-0165-4cef-af50-6aacb8c26cf0', '2d9f5450-6223-4bed-900d-8f5aa419a07f', 'df8edb8d-d098-42ec-b076-4fb87cdff75a', '09af3c67-c96a-42ab-8195-8fbc3aeb605f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-1d247c60-a907-455f-b91b-cdd8df55da76 req-b063b085-9041-4fa9-895b-4e01c6b53d57 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-1d247c60-a907-455f-b91b-cdd8df55da76 req-b063b085-9041-4fa9-895b-4e01c6b53d57 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-1d247c60-a907-455f-b91b-cdd8df55da76 req-b063b085-9041-4fa9-895b-4e01c6b53d57 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-1d247c60-a907-455f-b91b-cdd8df55da76 req-b063b085-9041-4fa9-895b-4e01c6b53d57 tempest-ServerActionsTestOtherA-385066909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-545ef7c1-35ec-4326-9704-5c55e352505a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8af121e-8ad7-4cef-a4e5-44fddfe60579', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:20:12 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:12 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-1d247c60-a907-455f-b91b-cdd8df55da76 req-b063b085-9041-4fa9-895b-4e01c6b53d57 tempest-ServerActionsTestOtherA-385066909 None] attachment_update completed successfully. Aug 28 16:20:12 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Deleted volume successfully. Aug 28 16:20:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-17351fbc-f111-4a87-afb3-ef50ec121217 tempest-AttachVolumeNegativeTest-149611832 None] Lock "cinder-a1cafe9a-426f-4701-b112-0b753fa29a99-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-51f3d88e-1694-4af1-97a6-b60283a24397 tempest-ServerActionsTestOtherA-385066909 None] Terminate volume connection completed successfully. Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-51f3d88e-1694-4af1-97a6-b60283a24397 tempest-ServerActionsTestOtherA-385066909 None] Deleting attachment f8af121e-8ad7-4cef-a4e5-44fddfe60579. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Flow 'volume_create_manager' (a630dc5c-2a40-444f-bf80-24b899fa1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef59706-2825-4c24-810f-7642f2367291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef59706-2825-4c24-810f-7642f2367291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-391470077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ef04da-630c-43e3-a38a-8db9e1612a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f619e6c194e5cab91462cd8b07cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:20:20Z,use_quota=True,user_id='a6cc0ddc20bc4639bb67de9d63dfce68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9f58ad-9024-494e-a894-348a83502c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9f58ad-9024-494e-a894-348a83502c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44c40e2-1bed-4aaf-a0d9-09d888621841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44c40e2-1bed-4aaf-a0d9-09d888621841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ef04da-630c-43e3-a38a-8db9e1612a5e', 'volume_name': 'volume-23ef04da-630c-43e3-a38a-8db9e1612a5e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909def5e-9c9d-48e4-83f0-b5bfdccdad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909def5e-9c9d-48e4-83f0-b5bfdccdad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61da33df-6f77-4b62-89f2-be203bcd6a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Volume 23ef04da-630c-43e3-a38a-8db9e1612a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ef04da-630c-43e3-a38a-8db9e1612a5e', 'volume_size': 1} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-391470077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ef04da-630c-43e3-a38a-8db9e1612a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f619e6c194e5cab91462cd8b07cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:20:20Z,use_quota=True,user_id='a6cc0ddc20bc4639bb67de9d63dfce68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Creating volume 23ef04da-630c-43e3-a38a-8db9e1612a5e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:20:20 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:20:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:20 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e 1073741824 Aug 28 16:20:20 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-aa1e5b16-e5d8-4cf5-853c-2e534624981d tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:21 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e 1073741824" returned: 0 in 0.812s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:21 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e Aug 28 16:20:21 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:21 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-aa1e5b16-e5d8-4cf5-853c-2e534624981d tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.496s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61da33df-6f77-4b62-89f2-be203bcd6a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ef04da-630c-43e3-a38a-8db9e1612a5e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd758d5-446b-4ecf-9c1c-1bf5498d9736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-aa1e5b16-e5d8-4cf5-853c-2e534624981d tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Volume volume-23ef04da-630c-43e3-a38a-8db9e1612a5e (23ef04da-630c-43e3-a38a-8db9e1612a5e): created successfully Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd758d5-446b-4ecf-9c1c-1bf5498d9736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Flow 'volume_create_manager' (a630dc5c-2a40-444f-bf80-24b899fa1b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:20:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a0972e68-8e80-457a-9298-ed662f053aed tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Created volume successfully. Aug 28 16:20:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-aa1e5b16-e5d8-4cf5-853c-2e534624981d tempest-ServerActionsTestOtherA-385066909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-545ef7c1-35ec-4326-9704-5c55e352505a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d99cf9b-b553-47a2-83b7-c28b54eee004', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:20:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-da2f3d41-0169-4142-b1ca-2ebbb7857b33 req-aa1e5b16-e5d8-4cf5-853c-2e534624981d tempest-ServerActionsTestOtherA-385066909 None] attachment_update completed successfully. Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Acquiring lock "cinder-23ef04da-630c-43e3-a38a-8db9e1612a5e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "cinder-23ef04da-630c-43e3-a38a-8db9e1612a5e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Acquiring lock "cinder-quobyte-23ef04da-630c-43e3-a38a-8db9e1612a5e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "cinder-quobyte-23ef04da-630c-43e3-a38a-8db9e1612a5e" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6cbd29-cfb8-450e-bb8b-d4cc28a9ea1d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:24 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e Aug 28 16:20:24 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:25 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e" returned: 0 in 0.680s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:25 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e Aug 28 16:20:25 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:25 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-23ef04da-630c-43e3-a38a-8db9e1612a5e" returned: 0 in 0.515s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "cinder-quobyte-23ef04da-630c-43e3-a38a-8db9e1612a5e" released by "delete_volume" :: held 1.281s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:25 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Created reservations ['0a5f1f40-5223-44cf-9112-9aef8042ce57', '651a7538-7b93-4405-a9ba-970b23cc560e', 'ce348d2e-679f-4f6e-92c9-a522e1ee2c9d', '7b1be1fe-8484-4669-8c46-c4439653f538'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:26 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:26 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:26 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Deleted volume successfully. Aug 28 16:20:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a90df5c9-ba86-414d-849f-f06e912fb332 tempest-VolumeQuotasNegativeTestJSON-1397832544 None] Lock "cinder-23ef04da-630c-43e3-a38a-8db9e1612a5e-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Flow 'volume_create_manager' (cba0100f-d3b2-41d7-9fb8-f521c9d40b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3b027-d59d-46d2-8dff-f88499454fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3b027-d59d-46d2-8dff-f88499454fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-921397007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e13f083-3433-4e2b-bae0-0a83fb12ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684418ce22e64c02904d63dc0790459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:20:30Z,use_quota=True,user_id='48a2a3170f964f438e77b98f63de564e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b1d34-aa46-40ac-b680-cf2a023504b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b1d34-aa46-40ac-b680-cf2a023504b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a510fb3-23e1-4698-95d7-62e3372e7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a510fb3-23e1-4698-95d7-62e3372e7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e13f083-3433-4e2b-bae0-0a83fb12ce9f', 'volume_name': 'volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c881005-ca9f-4d62-ade6-557aa927e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c881005-ca9f-4d62-ade6-557aa927e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec6aa6-c7e3-47d6-a6bb-ebd47e78d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:30 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Volume 0e13f083-3433-4e2b-bae0-0a83fb12ce9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f', 'volume_size': 1} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-921397007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e13f083-3433-4e2b-bae0-0a83fb12ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684418ce22e64c02904d63dc0790459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:20:30Z,use_quota=True,user_id='48a2a3170f964f438e77b98f63de564e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Creating volume 0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:20:30 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:20:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:30 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f 1073741824 Aug 28 16:20:30 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:31 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f 1073741824" returned: 0 in 0.965s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:31 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f Aug 28 16:20:31 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:31 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:31 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:31 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" returned: 0 in 0.396s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ec6aa6-c7e3-47d6-a6bb-ebd47e78d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6aa992-23af-440f-982e-bf82a607b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:20:31 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Volume volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f (0e13f083-3433-4e2b-bae0-0a83fb12ce9f): created successfully Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6aa992-23af-440f-982e-bf82a607b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:20:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Flow 'volume_create_manager' (cba0100f-d3b2-41d7-9fb8-f521c9d40b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:20:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-b250ea0c-4ff9-4019-8b73-3533c964f1f3 req-993b6b09-13e0-45f4-9b4c-8b97f1edaf04 tempest-VolumesSnapshotsTestJSON-818750696 None] Created volume successfully. Aug 28 16:20:32 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.621s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 8 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Creating offline snapshot 3f71133a-1628-47c6-9029-0469c89cba3f of volume 0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:20:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9ce0a-ff34-4e2f-bb29-f3db92cf4537]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:33 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f Aug 28 16:20:33 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:33 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" returned: 0 in 0.534s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:33 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f 1G Aug 28 16:20:33 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:34 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f 1G" returned: 0 in 0.751s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:34 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f Aug 28 16:20:34 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:34 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f" returned: 0 in 0.534s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:34 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f is being set with open permissions: ugo+rw Aug 28 16:20:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:34 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f Aug 28 16:20:34 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:35 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f" returned: 0 in 0.454s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:35 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info Aug 28 16:20:35 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:36 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info" returned: 0 in 1.166s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:36 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info is being set with open permissions: ugo+rw Aug 28 16:20:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:36 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info Aug 28 16:20:36 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:37 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.info" returned: 0 in 0.687s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.386s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-aea89959-3298-48bc-8a2c-2c88be54a576 req-216ff76f-cc8c-4f3b-bfb9-ce775643eb4a tempest-VolumesSnapshotsTestJSON-818750696 None] Create snapshot completed successfully Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "cinder-3f71133a-1628-47c6-9029-0469c89cba3f-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-3f71133a-1628-47c6-9029-0469c89cba3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "cinder-quobyte-3f71133a-1628-47c6-9029-0469c89cba3f" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-3f71133a-1628-47c6-9029-0469c89cba3f" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Deleting offline snapshot 3f71133a-1628-47c6-9029-0469c89cba3f of volume 0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] snapshot_file for this snap is: volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab1199-c1ae-4156-826b-767d9247671f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:39 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f Aug 28 16:20:39 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:40 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f" returned: 0 in 0.813s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7081633c-2e1f-416a-b0de-1a5c2f24dce2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:40 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f Aug 28 16:20:40 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:40 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" returned: 0 in 0.669s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:40 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f Aug 28 16:20:40 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:41 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f" returned: 0 in 0.651s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:41 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f Aug 28 16:20:41 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:41 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f.3f71133a-1628-47c6-9029-0469c89cba3f" returned: 0 in 0.430s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-3f71133a-1628-47c6-9029-0469c89cba3f" released by "_delete_snapshot" :: held 2.746s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" released by "delete_snapshot" :: held 2.832s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.quota [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Created reservations ['682bd38c-18bd-4915-a62a-04667812b3d4', '3aca9042-6445-4797-b311-087be3e12391', '41a7e1d8-3c2c-4e82-b963-ec956d8c55ae', '7102ea1a-c28d-4aa5-ab66-c775b2e78566'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Delete snapshot completed successfully. Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-dd6db4d0-37cd-4708-acda-3db9933e6a90 req-bd0408a0-7bae-4839-9fa5-5bb534b0b938 tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-3f71133a-1628-47c6-9029-0469c89cba3f-delete_snapshot" released by "delete_snapshot" :: held 3.101s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "cinder-0e13f083-3433-4e2b-bae0-0a83fb12ce9f-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-0e13f083-3433-4e2b-bae0-0a83fb12ce9f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8148982-a007-4837-b66d-6e1fac9ccf1f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:20:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:42 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f Aug 28 16:20:42 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:43 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" returned: 0 in 0.487s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:43 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f Aug 28 16:20:43 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:43 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" returned: 0 in 0.465s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-quobyte-0e13f083-3433-4e2b-bae0-0a83fb12ce9f" released by "delete_volume" :: held 1.062s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:43 devstack cinder-volume[86193]: DEBUG cinder.quota [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Created reservations ['1e0afd27-1065-4c19-a63c-3780445f17b9', '68c1e472-6063-45b8-9c3b-17ee5d43078c', 'eb675be8-4eaf-4054-a778-4a59dcde32e3', '17c98ff2-762b-4f15-b826-75c4e1cb90d5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:44 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:44 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:44 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.495s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG cinder.manager [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Deleted volume successfully. Aug 28 16:20:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-9b84aa2f-1664-4374-a8e1-501844aeec1f req-9c5e80dd-d6f9-4c68-8e89-5ce8eb00aefd tempest-VolumesSnapshotsTestJSON-818750696 None] Lock "cinder-0e13f083-3433-4e2b-bae0-0a83fb12ce9f-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:20:54 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=62,cinder:DELETE=5,cinder:UPDATE=55,cinder:INSERT=11 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:20:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-a423d5b8-4afa-4937-9011-1a0c892dfdf9 req-0e3d889e-10ff-4cc6-a80f-3c537f1788f9 tempest-ServerActionsTestOtherA-385066909 None] Terminate volume connection completed successfully. Aug 28 16:20:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-a423d5b8-4afa-4937-9011-1a0c892dfdf9 req-0e3d889e-10ff-4cc6-a80f-3c537f1788f9 tempest-ServerActionsTestOtherA-385066909 None] Deleting attachment 7d99cf9b-b553-47a2-83b7-c28b54eee004. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:20:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-492d7405-fdd0-4409-9b50-b6bfcc4d64bf tempest-GroupsV320Test-1026596402 None] Group tempest-GroupsV320Test-Group-2068859385: creating Aug 28 16:20:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-492d7405-fdd0-4409-9b50-b6bfcc4d64bf tempest-GroupsV320Test-1026596402 None] Group tempest-GroupsV320Test-Group-2068859385: created successfully Aug 28 16:20:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-492d7405-fdd0-4409-9b50-b6bfcc4d64bf tempest-GroupsV320Test-1026596402 None] Create group completed successfully. Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Created reservations ['72bfbda9-9b75-4d82-910d-eab83f83b5e4'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:20:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:20:57 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:20:57 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:20:58 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Aug 28 16:20:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.423s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:20:58 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:20:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d6403b73-216e-451e-8474-c1fc1c2f4b59 tempest-GroupsV320Test-1026596402 None] Delete group completed successfully. Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Flow 'volume_create_manager' (a49f7b10-f54a-49b7-89ca-e1b4e4a91925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999b5cf8-cc3c-42d1-b5ea-e9ab59aafc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999b5cf8-cc3c-42d1-b5ea-e9ab59aafc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042992132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e75fe0f-02c4-418e-85b0-b08d8a2ca235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ca99ad6bad48b0bbdaf52a2b905eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:02Z,use_quota=True,user_id='5ce9948f14724b729abd6fbd5a783d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df308eb-4619-4a9e-b290-dee20412415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df308eb-4619-4a9e-b290-dee20412415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba81c8a9-8933-48f8-9957-f98ebe1ebcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba81c8a9-8933-48f8-9957-f98ebe1ebcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e75fe0f-02c4-418e-85b0-b08d8a2ca235', 'volume_name': 'volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7547129-0e02-44a7-ba79-6d33faeba120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7547129-0e02-44a7-ba79-6d33faeba120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb0305-db2b-4e83-9191-ae9840b161f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Volume 6e75fe0f-02c4-418e-85b0-b08d8a2ca235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235', 'volume_size': 1} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042992132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e75fe0f-02c4-418e-85b0-b08d8a2ca235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ca99ad6bad48b0bbdaf52a2b905eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:02Z,use_quota=True,user_id='5ce9948f14724b729abd6fbd5a783d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Creating volume 6e75fe0f-02c4-418e-85b0-b08d8a2ca235 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:01 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 1073741824 Aug 28 16:21:01 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:02 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 1073741824" returned: 0 in 0.779s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:02 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 Aug 28 16:21:02 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:02 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" returned: 0 in 0.327s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb0305-db2b-4e83-9191-ae9840b161f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110c39e9-7748-45fc-806e-a48d0a75b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Volume volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 (6e75fe0f-02c4-418e-85b0-b08d8a2ca235): created successfully Aug 28 16:21:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110c39e9-7748-45fc-806e-a48d0a75b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Flow 'volume_create_manager' (a49f7b10-f54a-49b7-89ca-e1b4e4a91925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3784b18f-9087-4643-86f6-ab863a262c37 tempest-ServersNegativeTestJSON-1497647577 None] Created volume successfully. Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Flow 'volume_create_manager' (6b6d9bd6-d5b6-4bb3-bfcc-cb61f78fe37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a68a2bf-cd9e-4e45-970a-e60f5fc9905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a68a2bf-cd9e-4e45-970a-e60f5fc9905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1935450829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ca99ad6bad48b0bbdaf52a2b905eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:06Z,use_quota=True,user_id='5ce9948f14724b729abd6fbd5a783d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7c88d0-85ea-40d0-8714-fb64aa7608fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7c88d0-85ea-40d0-8714-fb64aa7608fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c6516-c083-45b0-992f-b4b5480cc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c6516-c083-45b0-992f-b4b5480cc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65', 'volume_name': 'volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ab5ef1-8ce2-42fe-ac2c-1732d80428a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ab5ef1-8ce2-42fe-ac2c-1732d80428a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c669e1-6069-4b66-a207-5636bb2ef309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Volume 29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65', 'volume_size': 1} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1935450829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ca99ad6bad48b0bbdaf52a2b905eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:06Z,use_quota=True,user_id='5ce9948f14724b729abd6fbd5a783d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Creating volume 29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:05 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 1073741824 Aug 28 16:21:05 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:06 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Flow 'volume_create_manager' (0ce22695-145b-4f1f-8bbe-14b85d56e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e96a6ff-31bf-45cf-9f2c-94d4d382d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=69,cinder:SELECT=62,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 1073741824" returned: 0 in 0.775s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e96a6ff-31bf-45cf-9f2c-94d4d382d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2073321574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9980a22d-cf78-4621-bf52-e0e1d1d5b044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4283df9ac049b69e6bb3d2a5983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:06Z,use_quota=True,user_id='ec9b5cd52b70456497b85c04487e4db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58a014e-3803-4cfb-af2f-05c4aa2372a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58a014e-3803-4cfb-af2f-05c4aa2372a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31c9c17-815a-4ff9-b796-d412d6702cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:21:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:06 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 Aug 28 16:21:06 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:07 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" returned: 0 in 0.382s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c669e1-6069-4b66-a207-5636bb2ef309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450aac7c-22a1-404b-a53c-33e77ad49b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Volume volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 (29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65): created successfully Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450aac7c-22a1-404b-a53c-33e77ad49b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Flow 'volume_create_manager' (6b6d9bd6-d5b6-4bb3-bfcc-cb61f78fe37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-462e85d9-72f0-4435-bbd3-e329caeacc78 tempest-ServersNegativeTestJSON-1497647577 None] Created volume successfully. Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31c9c17-815a-4ff9-b796-d412d6702cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'volume_name': 'volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a66ab5-dd19-4cf9-a21b-1e1677f20bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a66ab5-dd19-4cf9-a21b-1e1677f20bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccf1948-4744-4485-8ed9-7621ae6ceeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Trying to clone 9980a22d-cf78-4621-bf52-e0e1d1d5b044 from image bfd32705-759a-4eec-aec1-8d911107c463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:21:07 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Image download 20.69 MB at 20.69 MB/s Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6069c-959b-4c78-9fe3-b1eeec6465b7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:07 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD Aug 28 16:21:07 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:08 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 is fetched for user ec9b5cd52b70456497b85c04487e4db3. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b10b81-2ac4-4dcb-9dbf-1c190009dad9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "cinder-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "cinder-quobyte-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-quobyte-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:08 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD Aug 28 16:21:08 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f4b17-5c36-4026-9d52-36a301be437b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:08 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 Aug 28 16:21:08 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:08 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2073321574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9980a22d-cf78-4621-bf52-e0e1d1d5b044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4283df9ac049b69e6bb3d2a5983bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:06Z,use_quota=True,user_id='ec9b5cd52b70456497b85c04487e4db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Creating volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:08 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:08 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1073741824 Aug 28 16:21:08 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:09 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" returned: 0 in 0.529s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:09 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65 Aug 28 16:21:09 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:09 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" returned: 0 in 0.350s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-quobyte-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65" released by "delete_volume" :: held 0.981s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:09 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1073741824" returned: 0 in 0.675s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Created reservations ['4cbed6db-9444-4124-b04a-21379b2157c8', '31148a4a-b458-4b97-9807-866e98b3405c', 'fd179522-8779-4a83-b133-53fd81caa5fb', '4cd2a343-f935-4fe6-80c9-3803cb251ee2'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:09 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 Aug 28 16:21:09 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:09 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:09 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:10 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044" returned: 0 in 0.415s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Attempting download of bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e5423-303c-4348-a1fa-5c05f5b76838]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:10 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.452s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Deleted volume successfully. Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-904a72ab-d251-4217-8c72-200ce3b9020a tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-29c2ed85-c1f5-4cdb-a2eb-5ed8d0d46d65-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:10 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7 Aug 28 16:21:10 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:10 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:10 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7 Aug 28 16:21:10 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "cinder-6e75fe0f-02c4-418e-85b0-b08d8a2ca235-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-6e75fe0f-02c4-418e-85b0-b08d8a2ca235-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "cinder-quobyte-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-quobyte-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7251476-eed9-420f-bd4d-7df5130953c6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:11 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 Aug 28 16:21:11 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:11 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7" returned: 1 in 0.549s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_n1en0ez7' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bed4b6-8de2-4c0a-acd7-f4a1b71e2e16]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:11 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD Aug 28 16:21:11 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:11 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" returned: 0 in 0.583s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:11 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235 Aug 28 16:21:11 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:11 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] bfd32705-759a-4eec-aec1-8d911107c463 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:11 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 Aug 28 16:21:11 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:11 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-quobyte-6e75fe0f-02c4-418e-85b0-b08d8a2ca235" released by "delete_volume" :: held 1.131s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Created reservations ['788c8a21-342d-4d0a-a4d4-09c7b7f11110', '7ffd5a17-6e19-4891-a5bf-15dd15f509ec', '17446a6f-4b9e-427f-826f-41fd8efc2ec6', '0a75ddf9-6988-4124-913c-3fa150afcf36'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:12 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:12 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:12 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.414s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Deleted volume successfully. Aug 28 16:21:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f05ec25b-ac53-475c-90e4-ce2e6ff87bb7 tempest-ServersNegativeTestJSON-1497647577 None] Lock "cinder-6e75fe0f-02c4-418e-85b0-b08d8a2ca235-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:14 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044" returned: 0 in 2.966s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:14 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_k8kgbf8hdevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:21:14 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Converted 112.00 MB image at 37.75 MB/s Aug 28 16:21:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:14 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1G Aug 28 16:21:14 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:15 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 1G" returned: 0 in 0.556s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Downloaded image bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044 successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 for user ec9b5cd52b70456497b85c04487e4db3 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Marking volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044 as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Copying metadata from image bfd32705-759a-4eec-aec1-8d911107c463 to 9980a22d-cf78-4621-bf52-e0e1d1d5b044. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Creating volume glance metadata for volume 9980a22d-cf78-4621-bf52-e0e1d1d5b044 backed by image bfd32705-759a-4eec-aec1-8d911107c463 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccf1948-4744-4485-8ed9-7621ae6ceeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67a182e-9c62-4016-bf19-bb53b0fb1bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:15 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Volume volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 (9980a22d-cf78-4621-bf52-e0e1d1d5b044): created successfully Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67a182e-9c62-4016-bf19-bb53b0fb1bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Flow 'volume_create_manager' (0ce22695-145b-4f1f-8bbe-14b85d56e566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-09d32cca-f06d-433d-ab71-9d0460213c0f tempest-ServerActionsTestOtherA-385066909 None] Created volume successfully. Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-97d3bd39-5582-4290-bc55-d8f98b501dbf req-bcc7c27a-d5b2-4793-a4f2-892800ffdc7c tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-97d3bd39-5582-4290-bc55-d8f98b501dbf req-bcc7c27a-d5b2-4793-a4f2-892800ffdc7c tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-97d3bd39-5582-4290-bc55-d8f98b501dbf req-bcc7c27a-d5b2-4793-a4f2-892800ffdc7c tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-97d3bd39-5582-4290-bc55-d8f98b501dbf req-bcc7c27a-d5b2-4793-a4f2-892800ffdc7c tempest-ServerActionsTestOtherA-385066909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63feb400-0ace-4273-971d-f3e68951ed2d', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Flow 'volume_create_manager' (7a481af9-b347-45aa-a26b-fc5291a08440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba584ce3-99b3-4e5f-bc48-2557c22c9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-97d3bd39-5582-4290-bc55-d8f98b501dbf req-bcc7c27a-d5b2-4793-a4f2-892800ffdc7c tempest-ServerActionsTestOtherA-385066909 None] attachment_update completed successfully. Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba584ce3-99b3-4e5f-bc48-2557c22c9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-984106072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfc2ebc-ee5a-4042-ad95-944db1b291f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cc2f7477c34418bc59254f4bc17782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:21Z,use_quota=True,user_id='47c478f3de024c3fa7104c40a6f66b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4edd0c-3bae-4604-a009-38d6cd730c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4edd0c-3bae-4604-a009-38d6cd730c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9285c25-43bc-4219-af31-b3fcd834a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9285c25-43bc-4219-af31-b3fcd834a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfc2ebc-ee5a-4042-ad95-944db1b291f1', 'volume_name': 'volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c55c72-6d81-4664-9865-be18dad0759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c55c72-6d81-4664-9865-be18dad0759a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac21bf38-e858-4ffc-b824-510b684f60dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Volume 0dfc2ebc-ee5a-4042-ad95-944db1b291f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1', 'volume_size': 1} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-984106072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfc2ebc-ee5a-4042-ad95-944db1b291f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cc2f7477c34418bc59254f4bc17782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:21Z,use_quota=True,user_id='47c478f3de024c3fa7104c40a6f66b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Creating volume 0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:20 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:20 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 1073741824 Aug 28 16:21:20 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:21 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 1073741824" returned: 0 in 0.644s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:21 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 Aug 28 16:21:21 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:21 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac21bf38-e858-4ffc-b824-510b684f60dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38dff23-f0b3-4176-8db1-41d9ca0a3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Volume volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 (0dfc2ebc-ee5a-4042-ad95-944db1b291f1): created successfully Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38dff23-f0b3-4176-8db1-41d9ca0a3e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Flow 'volume_create_manager' (7a481af9-b347-45aa-a26b-fc5291a08440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b7d10286-92ba-4e93-9c8e-9c66cf15a6b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Created volume successfully. Aug 28 16:21:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Creating offline snapshot 258e3caf-91eb-40f0-97fb-3bbb137e2fa6 of volume 0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:21:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cbda64-3514-4899-b0b8-adbccf274e6a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:23 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 Aug 28 16:21:23 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:23 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" returned: 0 in 0.486s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:23 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 1G Aug 28 16:21:23 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:24 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 1G" returned: 0 in 0.533s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:24 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 Aug 28 16:21:24 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:24 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6" returned: 0 in 0.367s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:24 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 is being set with open permissions: ugo+rw Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:24 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 Aug 28 16:21:24 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:24 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6" returned: 0 in 0.287s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:24 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info Aug 28 16:21:24 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:25 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info" returned: 0 in 0.316s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:25 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info is being set with open permissions: ugo+rw Aug 28 16:21:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:25 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info Aug 28 16:21:25 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:25 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.info" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3a2f63c7-e3a3-4e34-a8c7-04ab65f7af75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Create snapshot completed successfully Aug 28 16:21:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "cinder-258e3caf-91eb-40f0-97fb-3bbb137e2fa6-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-258e3caf-91eb-40f0-97fb-3bbb137e2fa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "cinder-quobyte-258e3caf-91eb-40f0-97fb-3bbb137e2fa6" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-258e3caf-91eb-40f0-97fb-3bbb137e2fa6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Deleting offline snapshot 258e3caf-91eb-40f0-97fb-3bbb137e2fa6 of volume 0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] snapshot_file for this snap is: volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c81213-4799-44dd-b29d-401db1593668]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:27 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 Aug 28 16:21:27 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:27 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d4062-93a0-4c68-8766-23f6bbe084bf]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:27 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 Aug 28 16:21:27 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" returned: 0 in 0.528s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:28 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:28 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 Aug 28 16:21:28 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:28 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6" returned: 0 in 0.796s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:29 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6 Aug 28 16:21:29 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:29 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1.258e3caf-91eb-40f0-97fb-3bbb137e2fa6" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-258e3caf-91eb-40f0-97fb-3bbb137e2fa6" released by "_delete_snapshot" :: held 2.537s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" released by "delete_snapshot" :: held 2.597s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Created reservations ['e258636a-8cee-4b61-9ad7-d8cd3ac7f0f9', '554e4d76-99bd-4eb7-8a9e-108ff9511c32', 'dd716ea6-615a-45e8-8506-6a0831196a8c', 'c6c913d8-936d-4704-9e0d-a80af0b48198'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Delete snapshot completed successfully. Aug 28 16:21:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-31772cba-2641-4318-83e6-fc15c620b104 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-258e3caf-91eb-40f0-97fb-3bbb137e2fa6-delete_snapshot" released by "delete_snapshot" :: held 2.983s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "cinder-0dfc2ebc-ee5a-4042-ad95-944db1b291f1-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-0dfc2ebc-ee5a-4042-ad95-944db1b291f1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952f113-1c84-4b01-8054-0d30d1e4ace4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:30 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 Aug 28 16:21:30 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:31 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" returned: 0 in 0.822s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:31 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1 Aug 28 16:21:31 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:31 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:31 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:31 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" returned: 0 in 0.410s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:31 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-quobyte-0dfc2ebc-ee5a-4042-ad95-944db1b291f1" released by "delete_volume" :: held 1.357s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:21:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Created reservations ['bbaa2a11-0688-4d91-896a-664d7c9edbef', '952c5008-47c2-4556-b120-10d8e982fbdf', '413f9118-a8d0-44d4-b16d-e8f2e4ce6597', 'ee43dbd7-070b-49cd-b0ea-342fcacb8557'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:32 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:32 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:32 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Deleted volume successfully. Aug 28 16:21:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d4dbd666-6e07-40ee-878b-c74d2f298356 tempest-VolumeSnapshotQuotasNegativeTestJSON-2044585487 None] Lock "cinder-0dfc2ebc-ee5a-4042-ad95-944db1b291f1-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=55,cinder:UPDATE=51,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:21:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=40,cinder:SELECT=41,cinder:INSERT=18,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (4b139f59-18a9-465a-8237-661be2d8328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46925ee8-e0aa-487d-ba5f-ee3e0a25a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46925ee8-e0aa-487d-ba5f-ee3e0a25a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962177365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6740d3f5-b6a5-45f5-b731-66a0fd1a3e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:47Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69da8ef3-d8b8-49f8-8290-991d58bed245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69da8ef3-d8b8-49f8-8290-991d58bed245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8eada10-fc13-432a-88a5-4130a254d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8eada10-fc13-432a-88a5-4130a254d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6740d3f5-b6a5-45f5-b731-66a0fd1a3e11', 'volume_name': 'volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e818f2c9-f3b5-4b25-8fef-551ea50cbdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e818f2c9-f3b5-4b25-8fef-551ea50cbdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb03ca0e-091e-479b-b20e-ad1fe5fa95b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:47 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Volume 6740d3f5-b6a5-45f5-b731-66a0fd1a3e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11', 'volume_size': 1} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962177365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6740d3f5-b6a5-45f5-b731-66a0fd1a3e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:47Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Creating volume 6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:47 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:47 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 1073741824 Aug 28 16:21:47 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:21:48 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Flow 'volume_create_manager' (fa7be6e4-0434-48d3-abbb-708444fcc04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff831e3d-6360-41f4-b9da-320adf210e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 1073741824" returned: 0 in 0.956s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff831e3d-6360-41f4-b9da-320adf210e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1261501434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53460869-34a2-456c-a8f8-7db6a1970077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5373a4aa767f491493aa8c4aadf81dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:48Z,use_quota=True,user_id='6f467dcb361a49aab3c247871879b526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3b9fefc-017a-4f2d-a123-6f2061dd9bbc),volume_type_id=f3b9fefc-017a-4f2d-a123-6f2061dd9bbc)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86431cf5-534b-4f50-a793-88c9484fd582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86431cf5-534b-4f50-a793-88c9484fd582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243aa6e8-811e-4143-9e30-4a9d72f05790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243aa6e8-811e-4143-9e30-4a9d72f05790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53460869-34a2-456c-a8f8-7db6a1970077', 'volume_name': 'volume-53460869-34a2-456c-a8f8-7db6a1970077', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7bc85-ae6f-4c01-be98-ee17f22b8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7bc85-ae6f-4c01-be98-ee17f22b8189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690dfa8b-aba5-4154-9556-0a7c7e001987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Volume 53460869-34a2-456c-a8f8-7db6a1970077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53460869-34a2-456c-a8f8-7db6a1970077', 'volume_size': 1} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:48 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 Aug 28 16:21:48 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:49 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" returned: 0 in 0.472s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1261501434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53460869-34a2-456c-a8f8-7db6a1970077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5373a4aa767f491493aa8c4aadf81dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:21:48Z,use_quota=True,user_id='6f467dcb361a49aab3c247871879b526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3b9fefc-017a-4f2d-a123-6f2061dd9bbc),volume_type_id=f3b9fefc-017a-4f2d-a123-6f2061dd9bbc)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Creating volume 53460869-34a2-456c-a8f8-7db6a1970077 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:21:49 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb03ca0e-091e-479b-b20e-ad1fe5fa95b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8b0761-aba7-4c04-b8c8-66c1e2367c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:49 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Volume volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 (6740d3f5-b6a5-45f5-b731-66a0fd1a3e11): created successfully Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8b0761-aba7-4c04-b8c8-66c1e2367c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (4b139f59-18a9-465a-8237-661be2d8328b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:49 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 1073741824 Aug 28 16:21:49 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0140c481-eabc-4f24-9a35-4d3e949a7673 tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:21:50 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 1073741824" returned: 0 in 1.055s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:50 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 Aug 28 16:21:50 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b91a74bd-0932-4d5f-85dc-a93911404459 tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" by "attach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b91a74bd-0932-4d5f-85dc-a93911404459 tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" acquired by "attach_volume" :: waited 0.042s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b91a74bd-0932-4d5f-85dc-a93911404459 tempest-VolumesActionsTest-30694122 None] Attaching volume 6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 to instance a08a727e-957c-4897-bf18-fe450ea66863 at mountpoint /dev/vdb on host None. Aug 28 16:21:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b91a74bd-0932-4d5f-85dc-a93911404459 tempest-VolumesActionsTest-30694122 None] Attach volume completed successfully. Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b91a74bd-0932-4d5f-85dc-a93911404459 tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" released by "attach_volume" :: held 0.327s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:51 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077" returned: 0 in 0.821s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690dfa8b-aba5-4154-9556-0a7c7e001987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53460869-34a2-456c-a8f8-7db6a1970077', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3795fb66-57b9-4499-9195-21ae8f2cad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:21:51 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Volume volume-53460869-34a2-456c-a8f8-7db6a1970077 (53460869-34a2-456c-a8f8-7db6a1970077): created successfully Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3795fb66-57b9-4499-9195-21ae8f2cad54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Flow 'volume_create_manager' (fa7be6e4-0434-48d3-abbb-708444fcc04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:21:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e02edee1-732f-45e6-b53e-368034cbd377 tempest-VolumeTypesAccessTest-441661570 None] Created volume successfully. Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Acquiring lock "cinder-53460869-34a2-456c-a8f8-7db6a1970077-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "cinder-53460869-34a2-456c-a8f8-7db6a1970077-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Acquiring lock "cinder-quobyte-53460869-34a2-456c-a8f8-7db6a1970077" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "cinder-quobyte-53460869-34a2-456c-a8f8-7db6a1970077" acquired by "delete_volume" :: waited 0.051s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9788eae-c51e-4d11-8ae4-cd762e2d9d7e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:52 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 Aug 28 16:21:52 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Terminate volume connection completed successfully. Aug 28 16:21:53 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077" returned: 0 in 1.008s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:53 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077 Aug 28 16:21:53 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" by "detach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" acquired by "detach_volume" :: waited 0.076s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-ce12499a-9c29-4b1b-bbde-c15d7256602c tempest-ServerActionsTestOtherA-385066909 None] Terminate volume connection completed successfully. Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-ce12499a-9c29-4b1b-bbde-c15d7256602c tempest-ServerActionsTestOtherA-385066909 None] Deleting attachment 63feb400-0ace-4273-971d-f3e68951ed2d. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:21:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Detaching volume 6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 from instance a08a727e-957c-4897-bf18-fe450ea66863. Aug 28 16:21:53 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-53460869-34a2-456c-a8f8-7db6a1970077" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Detach volume completed successfully. Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "cinder-quobyte-53460869-34a2-456c-a8f8-7db6a1970077" released by "delete_volume" :: held 1.479s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1f200482-80dd-4d34-b93c-e543e51a12db tempest-VolumesActionsTest-7267691 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" released by "detach_volume" :: held 0.235s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:53 devstack cinder-volume[86193]: WARNING cinder.quota [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1450428782 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1450428782, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:21:53 devstack cinder-volume[86193]: WARNING cinder.quota [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1450428782 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1450428782, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Created reservations ['ee7e46de-7465-4d6b-96b8-74d92df24659', '7132b1d3-0d3c-4d9f-8a55-6e46c3bcd908', 'f7ef9a42-0060-4c31-a2b0-3422b907193c', '8e121a3d-52a8-45d2-9c4a-01edc628dda9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:54 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:54 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-24809689-b089-49ea-b75c-52520e7bf63c tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" by "detach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-24809689-b089-49ea-b75c-52520e7bf63c tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-24809689-b089-49ea-b75c-52520e7bf63c tempest-VolumesActionsTest-30694122 None] Volume detach called, but volume not attached. Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-24809689-b089-49ea-b75c-52520e7bf63c tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:54 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.774s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Deleted volume successfully. Aug 28 16:21:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-10e0d2ba-d616-44a1-9781-58db99a5d7de tempest-VolumeTypesAccessTest-441661570 None] Lock "cinder-53460869-34a2-456c-a8f8-7db6a1970077-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-quobyte-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "cinder-quobyte-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e847e9-fdc7-451e-b06f-b768540f81f8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:21:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:55 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 Aug 28 16:21:55 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:56 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" returned: 0 in 0.746s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:56 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11 Aug 28 16:21:56 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:56 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" returned: 0 in 0.602s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "cinder-quobyte-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11" released by "delete_volume" :: held 1.422s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Created reservations ['84315a1c-e067-4028-b9ce-0eb622b14723', '1bd5fe87-4cdf-4e15-a02e-83e3add19eb8', 'cc619633-aff4-4e51-b424-0b035b014a36', '4e4a3173-62a4-4e3b-8eef-e0a47b6b8c1d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:21:57 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:21:57 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:21:57 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.531s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:21:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Deleted volume successfully. Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-2a761ee2-dadf-4c94-acd5-dcec2c31a59e tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-2a761ee2-dadf-4c94-acd5-dcec2c31a59e tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cc7d864-0e06-44aa-ac2e-cc0079d7e957 tempest-VolumesActionsTest-30694122 None] Lock "cinder-6740d3f5-b6a5-45f5-b731-66a0fd1a3e11-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-2a761ee2-dadf-4c94-acd5-dcec2c31a59e tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:21:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-2a761ee2-dadf-4c94-acd5-dcec2c31a59e tempest-ServerActionsTestOtherA-385066909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9eb01a5b-b940-4350-abd1-2fda024c92ce', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:21:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-e5f24f7c-d010-44f9-ba8d-c722481052a8 req-2a761ee2-dadf-4c94-acd5-dcec2c31a59e tempest-ServerActionsTestOtherA-385066909 None] attachment_update completed successfully. Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (57dc8de3-a146-4b06-ba81-7e65d2f6154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfef59a-6e03-4025-961a-3bbeb5d9fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfef59a-6e03-4025-961a-3bbeb5d9fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017481640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:07Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9728d6-6637-4089-ad94-495cdb6521e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9728d6-6637-4089-ad94-495cdb6521e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b4f2da-27c4-4d03-a327-5c9e1684d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b4f2da-27c4-4d03-a327-5c9e1684d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c', 'volume_name': 'volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c842f9-7348-4af3-acbd-c71c819e5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c842f9-7348-4af3-acbd-c71c819e5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8d3166-f215-4f5f-8777-626ac9dfb2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Volume 9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c', 'volume_size': 1} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017481640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:07Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Creating volume 9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:06 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:06 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c 1073741824 Aug 28 16:22:06 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:07 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c 1073741824" returned: 0 in 1.187s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:08 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c Aug 28 16:22:08 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:08 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" returned: 0 in 0.464s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8d3166-f215-4f5f-8777-626ac9dfb2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dc1dbb-ad82-4b1f-a631-4e9d6898b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Volume volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c (9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c): created successfully Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dc1dbb-ad82-4b1f-a631-4e9d6898b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (57dc8de3-a146-4b06-ba81-7e65d2f6154f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-955c69d7-a58e-4419-af08-f0dbe9146582 tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "cinder-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-quobyte-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" acquired by "delete_volume" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd800c03-5046-423b-acd6-6f808e976b61]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:10 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c Aug 28 16:22:10 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:10 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" returned: 0 in 0.655s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:11 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c Aug 28 16:22:11 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:11 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" returned: 0 in 0.442s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c" released by "delete_volume" :: held 1.175s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Created reservations ['d7278fc1-7f97-407a-b04b-685bd3b6a1a4', '156c0592-214b-4ae3-a2c1-3f6d069f887b', '6283a361-db87-41ec-aa04-a757d16f61dd', '9a2d00f9-bd69-42ce-a7a1-592c0fa508d5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:11 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:11 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:12 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.399s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:12 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Deleted volume successfully. Aug 28 16:22:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7566b399-248c-48b6-8a05-4cbc7cfb86bf tempest-VolumesActionsTest-7267691 None] Lock "cinder-9bb0f7c8-96a5-419e-bc7c-7998f9c1e87c-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (6717c5c4-c72f-4923-92e2-eddcc5f8618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d1bd75-8fff-4855-9448-f26ffda81b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d1bd75-8fff-4855-9448-f26ffda81b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658206671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048584a5-f840-472d-b938-5ea021b82979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:13Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b115bde8-3077-4034-b2fa-4ae5cddab618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b115bde8-3077-4034-b2fa-4ae5cddab618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b346360-b115-4835-81c2-5ba549d166b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b346360-b115-4835-81c2-5ba549d166b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048584a5-f840-472d-b938-5ea021b82979', 'volume_name': 'volume-048584a5-f840-472d-b938-5ea021b82979', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b4397-7b39-435c-a9b9-392c1c87ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b4397-7b39-435c-a9b9-392c1c87ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec07ea4-b61e-462c-9928-852ebc5fdb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:13 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Volume 048584a5-f840-472d-b938-5ea021b82979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048584a5-f840-472d-b938-5ea021b82979', 'volume_size': 1} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658206671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048584a5-f840-472d-b938-5ea021b82979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:13Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Creating volume 048584a5-f840-472d-b938-5ea021b82979 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:13 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:13 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 1073741824 Aug 28 16:22:13 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:14 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 1073741824" returned: 0 in 0.778s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:14 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 Aug 28 16:22:14 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:15 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979" returned: 0 in 0.552s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec07ea4-b61e-462c-9928-852ebc5fdb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048584a5-f840-472d-b938-5ea021b82979', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142f85f9-e4c4-4c6f-b874-58923a4b7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:15 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Volume volume-048584a5-f840-472d-b938-5ea021b82979 (048584a5-f840-472d-b938-5ea021b82979): created successfully Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142f85f9-e4c4-4c6f-b874-58923a4b7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (6717c5c4-c72f-4923-92e2-eddcc5f8618b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a49e7a13-a7d6-47a0-ae5b-69edd682c09d tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:22:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-048584a5-f840-472d-b938-5ea021b82979-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "cinder-048584a5-f840-472d-b938-5ea021b82979-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-quobyte-048584a5-f840-472d-b938-5ea021b82979" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-048584a5-f840-472d-b938-5ea021b82979" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[98943521-2737-427d-918c-e353d3ec980e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:16 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 Aug 28 16:22:16 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:16 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979" returned: 0 in 0.568s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:16 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979 Aug 28 16:22:16 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:17 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-048584a5-f840-472d-b938-5ea021b82979" returned: 0 in 0.363s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-048584a5-f840-472d-b938-5ea021b82979" released by "delete_volume" :: held 0.978s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Created reservations ['a1e99a79-1d33-4a12-81e6-a26436cf4c96', 'b5fde9c7-efe9-4f37-8781-cdc10e9bb65c', 'c7c069dd-1344-4d67-b610-3a3335a14f59', 'c6a62ef7-febb-477a-9160-3cb37b3f06d5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:17 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:17 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:17 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Deleted volume successfully. Aug 28 16:22:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8cb90c57-6de1-436d-804b-b303bfaf1e4b tempest-VolumesActionsTest-7267691 None] Lock "cinder-048584a5-f840-472d-b938-5ea021b82979-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (20a30b19-8df5-4e4d-ab7b-14f703a01c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99255810-8ccb-421b-9844-e4bebdb7febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99255810-8ccb-421b-9844-e4bebdb7febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2096368153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4cb128-f7e7-4c99-a553-a4733432fc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:20Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743a22d5-5b2c-486d-a8c9-9d2115ce6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743a22d5-5b2c-486d-a8c9-9d2115ce6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c055c-6c05-4043-abbc-72aeccdb581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751c055c-6c05-4043-abbc-72aeccdb581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4cb128-f7e7-4c99-a553-a4733432fc88', 'volume_name': 'volume-6f4cb128-f7e7-4c99-a553-a4733432fc88', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee4a896-37fe-4f8e-aac3-ea3da6a5d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee4a896-37fe-4f8e-aac3-ea3da6a5d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9c2a24-ffed-44e4-ace4-983d736dc2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:19 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Volume 6f4cb128-f7e7-4c99-a553-a4733432fc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4cb128-f7e7-4c99-a553-a4733432fc88', 'volume_size': 1} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2096368153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4cb128-f7e7-4c99-a553-a4733432fc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:20Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Creating volume 6f4cb128-f7e7-4c99-a553-a4733432fc88 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:19 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:19 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 1073741824 Aug 28 16:22:19 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:20 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 1073741824" returned: 0 in 0.874s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:20 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 Aug 28 16:22:20 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:21 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9c2a24-ffed-44e4-ace4-983d736dc2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4cb128-f7e7-4c99-a553-a4733432fc88', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4737c7-69a1-4d76-907b-6809dd1e82e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Volume volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 (6f4cb128-f7e7-4c99-a553-a4733432fc88): created successfully Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4737c7-69a1-4d76-907b-6809dd1e82e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (20a30b19-8df5-4e4d-ab7b-14f703a01c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9e7d052d-94d3-4d87-a360-257ff098a2c2 tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-6f4cb128-f7e7-4c99-a553-a4733432fc88-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "cinder-6f4cb128-f7e7-4c99-a553-a4733432fc88-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-quobyte-6f4cb128-f7e7-4c99-a553-a4733432fc88" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-6f4cb128-f7e7-4c99-a553-a4733432fc88" acquired by "delete_volume" :: waited 0.058s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[698a0c86-d8b5-493c-920d-3ab83b5de0d6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:22 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 Aug 28 16:22:22 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:22 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88" returned: 0 in 0.514s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:22 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88 Aug 28 16:22:22 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:22 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f4cb128-f7e7-4c99-a553-a4733432fc88" returned: 0 in 0.426s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-6f4cb128-f7e7-4c99-a553-a4733432fc88" released by "delete_volume" :: held 1.017s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Created reservations ['e54ef0ed-506c-4cd7-a235-d55da93f2178', '21546129-2ff5-42cf-9d53-317b7ea7f284', '6c683b77-fcda-47c6-9df3-60b8dc4c1ae0', 'aed62ffe-76bc-4d1d-8268-e3dd5b9009c2'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:23 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:23 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:23 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.322s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:23 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Deleted volume successfully. Aug 28 16:22:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-57f28b15-6644-42bb-aa87-8579eb64d476 tempest-VolumesActionsTest-7267691 None] Lock "cinder-6f4cb128-f7e7-4c99-a553-a4733432fc88-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Flow 'volume_create_manager' (f6bd07bf-426b-4678-8715-d4af04f94d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415ab668-b96a-4e00-aaa1-534ed829ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415ab668-b96a-4e00-aaa1-534ed829ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-273183500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad1fa80-46e8-4d50-bb07-55a28bae0f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68538ae33ce0422c8cd73c79aa0472fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:24Z,use_quota=True,user_id='ff20f35a4bc14db28adf6846afb74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e79db1-af78-444d-8bc1-2213e6ffec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e79db1-af78-444d-8bc1-2213e6ffec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57d55e8-6c78-48a2-aa19-e3f243fb5c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57d55e8-6c78-48a2-aa19-e3f243fb5c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ad1fa80-46e8-4d50-bb07-55a28bae0f2b', 'volume_name': 'volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9400d95-fd62-4704-9dc2-8b794ae43047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9400d95-fd62-4704-9dc2-8b794ae43047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7b1d91-8c5c-4baf-9a80-3a3a579c1686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Trying to clone 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b from image bfd32705-759a-4eec-aec1-8d911107c463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:22:24 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (7d3d77a5-fc3a-464c-8e57-b55cd7e9c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac9e7f-0481-40a4-83e8-c02d68e310ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac9e7f-0481-40a4-83e8-c02d68e310ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-13068288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e01509-2200-404f-8095-5c56e34c16f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:25Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709a3132-110c-4141-8e14-b67e85cdcc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709a3132-110c-4141-8e14-b67e85cdcc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dccfff-a498-43d4-9d7e-7f4b35335b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dccfff-a498-43d4-9d7e-7f4b35335b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e01509-2200-404f-8095-5c56e34c16f9', 'volume_name': 'volume-82e01509-2200-404f-8095-5c56e34c16f9', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb99e5f-d840-448b-a47b-588c3af89f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb99e5f-d840-448b-a47b-588c3af89f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0312bdd2-e1be-401b-8fdb-d24b25dbc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Volume 82e01509-2200-404f-8095-5c56e34c16f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e01509-2200-404f-8095-5c56e34c16f9', 'volume_size': 1} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-13068288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e01509-2200-404f-8095-5c56e34c16f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:25Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Creating volume 82e01509-2200-404f-8095-5c56e34c16f9 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:25 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:25 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 1073741824 Aug 28 16:22:25 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:22:25 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Image download 20.69 MB at 20.69 MB/s Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[57550162-1c82-4962-8038-3fd5c43f7a44]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:25 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD Aug 28 16:22:25 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:25 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 1073741824" returned: 0 in 0.506s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:25 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 Aug 28 16:22:25 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:25 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 is fetched for user ff20f35a4bc14db28adf6846afb74b69. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758ddfa-62d6-4be1-b4db-b102133644b0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:26 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0312bdd2-e1be-401b-8fdb-d24b25dbc054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e01509-2200-404f-8095-5c56e34c16f9', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a8046b-df4b-4c52-8c89-917d87e9b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Volume volume-82e01509-2200-404f-8095-5c56e34c16f9 (82e01509-2200-404f-8095-5c56e34c16f9): created successfully Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a8046b-df4b-4c52-8c89-917d87e9b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:26 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD Aug 28 16:22:26 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (7d3d77a5-fc3a-464c-8e57-b55cd7e9c266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a66cac23-e7f4-411c-9f71-2ead246db374 tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:22:26 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-273183500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad1fa80-46e8-4d50-bb07-55a28bae0f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68538ae33ce0422c8cd73c79aa0472fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:24Z,use_quota=True,user_id='ff20f35a4bc14db28adf6846afb74b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Creating volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:26 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:26 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1073741824 Aug 28 16:22:26 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:26 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1073741824" returned: 0 in 0.446s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:26 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b Aug 28 16:22:26 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:27 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" returned: 0 in 0.307s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Attempting download of bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[affad448-300e-4806-94fd-652520197597]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-82e01509-2200-404f-8095-5c56e34c16f9-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "cinder-82e01509-2200-404f-8095-5c56e34c16f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Acquiring lock "cinder-quobyte-82e01509-2200-404f-8095-5c56e34c16f9" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-82e01509-2200-404f-8095-5c56e34c16f9" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:27 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan Aug 28 16:22:27 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[81291fb7-b58e-40b1-9ca7-3efa414cc1b2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:27 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 Aug 28 16:22:27 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:27 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan" returned: 0 in 0.465s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:27 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan Aug 28 16:22:27 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:27 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9" returned: 0 in 0.454s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:27 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9 Aug 28 16:22:27 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:28 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan" returned: 1 in 0.396s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_hjqwmcan' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d5466-4ece-41a4-8fe9-9431ac63d960]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:28 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-82e01509-2200-404f-8095-5c56e34c16f9" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "cinder-quobyte-82e01509-2200-404f-8095-5c56e34c16f9" released by "delete_volume" :: held 0.840s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:28 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD Aug 28 16:22:28 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Created reservations ['18c54b83-d398-4df7-8446-ec62921634e0', '397e06f3-3c68-4122-aa8b-72b7f1a396df', '85616f24-af9f-42f2-b8c4-483ea79fb18f', 'ed5ffc99-36b5-42ac-93d5-26d766f2eb66'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:28 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:28 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:28 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD" returned: 0 in 0.607s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] bfd32705-759a-4eec-aec1-8d911107c463 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:22:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:28 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b Aug 28 16:22:28 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:29 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.566s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Deleted volume successfully. Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e00e44cb-431e-4779-a558-b50aea7d47f5 tempest-VolumesActionsTest-7267691 None] Lock "cinder-82e01509-2200-404f-8095-5c56e34c16f9-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (4277cef7-541a-4c59-a06b-c8e9cbf8c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734135b5-abc7-42a5-9d9b-44ace09c40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734135b5-abc7-42a5-9d9b-44ace09c40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261403995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca10ebd3-9b3e-4b92-b4f6-c66111eff80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:29Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af599758-a9a4-4994-8f0a-906c3794681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af599758-a9a4-4994-8f0a-906c3794681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa957b39-5e76-4a16-9494-99f2f2c8b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa957b39-5e76-4a16-9494-99f2f2c8b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca10ebd3-9b3e-4b92-b4f6-c66111eff80f', 'volume_name': 'volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6776df9-7406-4f4e-a4d8-d41768b23e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6776df9-7406-4f4e-a4d8-d41768b23e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab508c25-c48c-48fb-ac68-795e96586515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Volume ca10ebd3-9b3e-4b92-b4f6-c66111eff80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f', 'volume_size': 1} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261403995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca10ebd3-9b3e-4b92-b4f6-c66111eff80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795a317ddec441e2b5c97ce736fc9614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:29Z,use_quota=True,user_id='03a1ed376f4343c7bb48044d3e014956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Creating volume ca10ebd3-9b3e-4b92-b4f6-c66111eff80f {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:29 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:29 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f 1073741824 Aug 28 16:22:29 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:30 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f 1073741824" returned: 0 in 0.769s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:30 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f Aug 28 16:22:30 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:31 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" returned: 0 in 0.566s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab508c25-c48c-48fb-ac68-795e96586515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd19d466-2f97-4407-9bb2-186b3c238ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:31 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Volume volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f (ca10ebd3-9b3e-4b92-b4f6-c66111eff80f): created successfully Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd19d466-2f97-4407-9bb2-186b3c238ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Flow 'volume_create_manager' (4277cef7-541a-4c59-a06b-c8e9cbf8c56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-fdaf0312-6be6-4728-9052-3d35a74072c3 tempest-VolumesActionsTest-30694122 None] Created volume successfully. Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:31 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:31 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:32 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" returned: 0 in 3.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0z9jk_23devstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:22:32 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:32 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Converted 112.00 MB image at 34.32 MB/s Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.631s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:32 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1G Aug 28 16:22:32 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:22:32 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b 1G" returned: 0 in 0.717s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Downloaded image bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 for user ff20f35a4bc14db28adf6846afb74b69 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Marking volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Copying metadata from image bfd32705-759a-4eec-aec1-8d911107c463 to 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:22:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Creating volume glance metadata for volume 8ad1fa80-46e8-4d50-bb07-55a28bae0f2b backed by image bfd32705-759a-4eec-aec1-8d911107c463 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7b1d91-8c5c-4baf-9a80-3a3a579c1686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ac40b3-e7e6-4dd5-87c9-df8dfd3922f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:33 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Volume volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b (8ad1fa80-46e8-4d50-bb07-55a28bae0f2b): created successfully Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ac40b3-e7e6-4dd5-87c9-df8dfd3922f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Flow 'volume_create_manager' (f6bd07bf-426b-4678-8715-d4af04f94d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8228c81b-34b0-4a8c-8a80-77a0bddcd4f6 tempest-VolumesImageMetadata-2102248866 None] Created volume successfully. Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "cinder-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Acquiring lock "cinder-quobyte-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "cinder-quobyte-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" acquired by "delete_volume" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678366f-a939-4471-8578-8ba7084b3dac]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:33 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f Aug 28 16:22:33 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Acquiring lock "cinder-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "cinder-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:34 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Acquiring lock "cinder-quobyte-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" returned: 0 in 0.779s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "cinder-quobyte-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:34 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f Aug 28 16:22:34 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-1eac5d18-e5a6-49b3-9bf9-b94819cc3c83 tempest-ServerActionsTestOtherA-385066909 None] Terminate volume connection completed successfully. Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-1eac5d18-e5a6-49b3-9bf9-b94819cc3c83 tempest-ServerActionsTestOtherA-385066909 None] Deleting attachment 9eb01a5b-b940-4350-abd1-2fda024c92ce. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ccd7f-b4e5-4f35-a058-972e56451edc]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:34 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b Aug 28 16:22:34 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "cinder-9980a22d-cf78-4621-bf52-e0e1d1d5b044-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-9980a22d-cf78-4621-bf52-e0e1d1d5b044-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "cinder-quobyte-9980a22d-cf78-4621-bf52-e0e1d1d5b044" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-quobyte-9980a22d-cf78-4621-bf52-e0e1d1d5b044" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:34 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" returned: 0 in 0.348s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe5f442-19b3-416e-b715-e3f74b095149]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "cinder-quobyte-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f" released by "delete_volume" :: held 1.185s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:34 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Created reservations ['9728dd59-3156-4a7e-a064-0ee69e30c1d0', '2f4c51fb-bad1-4627-8b4a-dd59d6daba8c', '9678d19a-f368-4844-9462-c20aeee5f17f', '0c2760bf-5acd-463a-91af-494323e49ea8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:34 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 Aug 28 16:22:34 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:35 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:35 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b Aug 28 16:22:35 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.281s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:35 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Deleted volume successfully. Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" returned: 0 in 0.284s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "cinder-quobyte-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b" released by "delete_volume" :: held 0.874s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:35 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3c2c68ad-f39c-45ed-9dfd-65748f701a42 tempest-VolumesActionsTest-30694122 None] Lock "cinder-ca10ebd3-9b3e-4b92-b4f6-c66111eff80f-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044" returned: 0 in 0.553s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044 Aug 28 16:22:35 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Created reservations ['1dd75ccf-042d-4426-80e5-67ff4c759c98', '43de1629-8162-4217-962d-6b62a1005e92', '68eecf88-7b84-4ea9-84d9-adb8fbfb66aa', '22b4799d-8d9d-4522-9273-fc46603cab3c'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:35 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9980a22d-cf78-4621-bf52-e0e1d1d5b044" returned: 0 in 0.269s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-quobyte-9980a22d-cf78-4621-bf52-e0e1d1d5b044" released by "delete_volume" :: held 0.886s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "cinder-545ef7c1-35ec-4326-9704-5c55e352505a-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-545ef7c1-35ec-4326-9704-5c55e352505a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.quota [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Created reservations ['c808f266-d84d-4130-893a-431166e5c7e0', '6addf6fb-275e-40aa-a3d3-eaf960ea9652', 'b059a06b-ba7e-4840-837d-b52a1d6062ec', '5a15637d-5eda-488e-9b8c-4ea12f85c4e7'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "cinder-quobyte-545ef7c1-35ec-4326-9704-5c55e352505a" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-quobyte-545ef7c1-35ec-4326-9704-5c55e352505a" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:35 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2d73b-c5ea-4ab8-bb77-922ca6259c58]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.379s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Deleted volume successfully. Aug 28 16:22:35 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:35 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e0edc557-3023-43b9-afc0-65cc9e5813c8 tempest-VolumesImageMetadata-2102248866 None] Lock "cinder-8ad1fa80-46e8-4d50-bb07-55a28bae0f2b-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:36 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a Aug 28 16:22:36 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:36 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.320s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.manager [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Deleted volume successfully. Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-b0e4280d-e760-497b-bcc0-db45f161a783 req-b6248101-6420-48ef-8405-5adce63c6930 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-9980a22d-cf78-4621-bf52-e0e1d1d5b044-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:36 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a" returned: 0 in 0.439s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:36 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a Aug 28 16:22:36 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:36 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-545ef7c1-35ec-4326-9704-5c55e352505a" returned: 0 in 0.283s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-quobyte-545ef7c1-35ec-4326-9704-5c55e352505a" released by "delete_volume" :: held 0.789s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Created reservations ['011e51b9-8262-4d84-8264-0af6bad9ade3', 'c2db354f-1db4-432c-9ed5-01454e1562d3', '9444e5f5-0fe6-4cc3-b948-b4604fc5ba7a', '450f6483-5efd-4ca7-8769-bfc0eaf57eb9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:36 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:36 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:37 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.437s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:37 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Deleted volume successfully. Aug 28 16:22:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6339235f-4776-49fa-8aa9-9b3c8722dbc8 tempest-ServerActionsTestOtherA-385066909 None] Lock "cinder-545ef7c1-35ec-4326-9704-5c55e352505a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=86,cinder:UPDATE=108,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Flow 'volume_create_manager' (19a22de7-8fbc-4da6-9b29-efcc61d6c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d955327-dc39-41ee-bb31-da29885d72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d955327-dc39-41ee-bb31-da29885d72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-682490759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7936218a74a34461be349858b5fa6cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:42Z,use_quota=True,user_id='bc01ec14e5cc4ac193cdf29ab74461f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b7c1da-863c-416a-b1a0-ef2d04a9be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b7c1da-863c-416a-b1a0-ef2d04a9be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d3fc5b-ba36-4176-b504-5bc86340d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d3fc5b-ba36-4176-b504-5bc86340d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4', 'volume_name': 'volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e90389-12f6-4331-8d83-c67a5867a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e90389-12f6-4331-8d83-c67a5867a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4a81e6-ba17-460a-acc6-777111f98d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:42 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Volume 1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4', 'volume_size': 1} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-682490759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7936218a74a34461be349858b5fa6cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:42Z,use_quota=True,user_id='bc01ec14e5cc4ac193cdf29ab74461f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Creating volume 1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:42 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:42 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 1073741824 Aug 28 16:22:42 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:42 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 1073741824" returned: 0 in 0.610s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=114,cinder:SELECT=96,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:43 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 Aug 28 16:22:43 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:43 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4a81e6-ba17-460a-acc6-777111f98d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa319255-2875-4863-ad3a-58e50e7aeeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:43 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Volume volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 (1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4): created successfully Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa319255-2875-4863-ad3a-58e50e7aeeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Flow 'volume_create_manager' (19a22de7-8fbc-4da6-9b29-efcc61d6c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6795aed3-8583-4477-9faf-141d39e846e2 tempest-SnapshotMetadataTestJSON-55555403 None] Created volume successfully. Aug 28 16:22:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Creating offline snapshot 1d8ea755-36c0-4f52-a79c-9ac599aaa367 of volume 1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:22:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb56731-6da3-419d-8356-87840184563e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:44 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 Aug 28 16:22:44 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:45 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" returned: 0 in 0.764s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:45 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 1G Aug 28 16:22:45 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (9a8988ab-c135-4184-9b48-ff8b2a512097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71476c7-8c1d-436b-8384-8446676e3f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71476c7-8c1d-436b-8384-8446676e3f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2083303322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e929fae-0a36-4781-8b20-545318ab916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:45Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572aa2ef-9e0a-42f0-b47e-5016dd79db88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572aa2ef-9e0a-42f0-b47e-5016dd79db88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f1754-c63a-4f85-91b1-0d433c1614cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f1754-c63a-4f85-91b1-0d433c1614cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e929fae-0a36-4781-8b20-545318ab916b', 'volume_name': 'volume-0e929fae-0a36-4781-8b20-545318ab916b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3791695f-c429-4e21-b224-1c063d24c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3791695f-c429-4e21-b224-1c063d24c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae14136-32f4-4498-891e-78a931efc765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Volume 0e929fae-0a36-4781-8b20-545318ab916b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e929fae-0a36-4781-8b20-545318ab916b', 'volume_size': 1} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:45 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 1G" returned: 0 in 0.533s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:45 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 Aug 28 16:22:45 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:46 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:46 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 is being set with open permissions: ugo+rw Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:46 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 Aug 28 16:22:46 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:46 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367" returned: 0 in 0.315s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:46 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info Aug 28 16:22:46 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:46 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:46 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info is being set with open permissions: ugo+rw Aug 28 16:22:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:46 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info Aug 28 16:22:46 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:47 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.info" returned: 0 in 0.377s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.900s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2083303322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e929fae-0a36-4781-8b20-545318ab916b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:45Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Creating volume 0e929fae-0a36-4781-8b20-545318ab916b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:47 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:47 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b 1073741824 Aug 28 16:22:47 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9bd67936-628a-4252-8e2e-873b3639f3ae tempest-SnapshotMetadataTestJSON-55555403 None] Create snapshot completed successfully Aug 28 16:22:48 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b 1073741824" returned: 0 in 0.666s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:48 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b Aug 28 16:22:48 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:48 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae14136-32f4-4498-891e-78a931efc765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e929fae-0a36-4781-8b20-545318ab916b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c94fda9-5022-4159-b61e-1fa8a1ddd07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Volume volume-0e929fae-0a36-4781-8b20-545318ab916b (0e929fae-0a36-4781-8b20-545318ab916b): created successfully Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c94fda9-5022-4159-b61e-1fa8a1ddd07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (9a8988ab-c135-4184-9b48-ff8b2a512097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c1f61eea-2ad9-4ff1-afc0-9ac112fb0e4b tempest-AttachVolumeTestJSON-1175656600 None] Created volume successfully. Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "cinder-1d8ea755-36c0-4f52-a79c-9ac599aaa367-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-1d8ea755-36c0-4f52-a79c-9ac599aaa367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "cinder-quobyte-1d8ea755-36c0-4f52-a79c-9ac599aaa367" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d8ea755-36c0-4f52-a79c-9ac599aaa367" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Deleting offline snapshot 1d8ea755-36c0-4f52-a79c-9ac599aaa367 of volume 1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] snapshot_file for this snap is: volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4704545f-ac71-4d27-ba95-829d1bf41a2f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:49 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 Aug 28 16:22:49 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:49 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367" returned: 0 in 0.461s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be71ea-dea3-488d-8fcb-9323034e8e16]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:49 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 Aug 28 16:22:49 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:49 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" returned: 0 in 0.457s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:49 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 Aug 28 16:22:49 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:50 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367" returned: 0 in 0.733s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:50 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367 Aug 28 16:22:50 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9e2ac86b-8a8c-480e-87d7-9a9063b4197a req-8482ace2-8f9e-450e-90bb-861aaf75742d tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9e2ac86b-8a8c-480e-87d7-9a9063b4197a req-8482ace2-8f9e-450e-90bb-861aaf75742d tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-9e2ac86b-8a8c-480e-87d7-9a9063b4197a req-8482ace2-8f9e-450e-90bb-861aaf75742d tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-9e2ac86b-8a8c-480e-87d7-9a9063b4197a req-8482ace2-8f9e-450e-90bb-861aaf75742d tempest-AttachVolumeTestJSON-1175656600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-0e929fae-0a36-4781-8b20-545318ab916b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '660ecfb0-d235-4b2a-b907-a4c615c011c3', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:22:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-9e2ac86b-8a8c-480e-87d7-9a9063b4197a req-8482ace2-8f9e-450e-90bb-861aaf75742d tempest-AttachVolumeTestJSON-1175656600 None] attachment_update completed successfully. Aug 28 16:22:51 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4.1d8ea755-36c0-4f52-a79c-9ac599aaa367" returned: 0 in 0.458s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d8ea755-36c0-4f52-a79c-9ac599aaa367" released by "_delete_snapshot" :: held 2.272s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" released by "delete_snapshot" :: held 2.306s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:51 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Created reservations ['8f15eb3a-301c-4307-a1fa-cab4c9ea4aff', '2e37b1f6-400a-4a3b-9dd8-8e826e96d411', '096b148b-149b-479b-ac63-5fa5bf49253e', '03461549-fe88-48f5-8009-953a470997dc'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Delete snapshot completed successfully. Aug 28 16:22:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ecb4907d-2eef-49e3-bdbb-d3beaa6c291c tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-1d8ea755-36c0-4f52-a79c-9ac599aaa367-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "cinder-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b48214c-ecb6-4c5b-8a17-3942b8b2fa09]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:52 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 Aug 28 16:22:52 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:52 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" returned: 0 in 0.521s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:52 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4 Aug 28 16:22:52 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:53 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-quobyte-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4" released by "delete_volume" :: held 0.969s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Created reservations ['d0c8c6fd-1706-46ee-81f9-cb934d9ea445', '329a3937-a299-4cde-95b5-f11015009e81', 'cbec0d34-8edb-4a16-ab8e-45ae59c70245', '265271e6-f01a-4567-b4b6-a808f47bea09'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:53 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:22:53 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:53 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:22:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Deleted volume successfully. Aug 28 16:22:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9f482929-1d17-45d1-9b07-c4ce436170b1 tempest-SnapshotMetadataTestJSON-55555403 None] Lock "cinder-1d424c3e-4f98-4017-8d9b-1bbd3ca3adb4-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Flow 'volume_create_manager' (bb3fe4c6-152a-4111-9ecf-eb6a5335ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96f6ac-fc19-4de1-9599-f4e4cf19cfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96f6ac-fc19-4de1-9599-f4e4cf19cfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2071826139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0548dffcd9847fda3d6430519f798c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:59Z,use_quota=True,user_id='3c3f023931a14198b74d5a3a541e3c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3d9153-5390-4fe9-a09f-05365cd6b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3d9153-5390-4fe9-a09f-05365cd6b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1cb772-3e5a-4783-95a5-ca8c4951b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1cb772-3e5a-4783-95a5-ca8c4951b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612', 'volume_name': 'volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46b68e6-d6f4-4714-8a78-f8e054214313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46b68e6-d6f4-4714-8a78-f8e054214313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e8a775-d3a7-4009-9baa-ea91194945f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:22:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Volume 7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612', 'volume_size': 1} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2071826139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0548dffcd9847fda3d6430519f798c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:22:59Z,use_quota=True,user_id='3c3f023931a14198b74d5a3a541e3c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Creating volume 7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:22:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:22:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:59 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 1073741824 Aug 28 16:22:59 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:22:59 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Aug 28 16:22:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 1073741824" returned: 0 in 0.705s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:22:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:22:59 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 Aug 28 16:22:59 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:00 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" returned: 0 in 0.693s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e8a775-d3a7-4009-9baa-ea91194945f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdc507f-98e6-4034-828b-00eafc429f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Volume volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 (7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612): created successfully Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdc507f-98e6-4034-828b-00eafc429f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Flow 'volume_create_manager' (bb3fe4c6-152a-4111-9ecf-eb6a5335ea90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-87eb8297-8c69-4e9c-9185-0069dbbb2324 tempest-AbsoluteLimitsTests-444926179 None] Created volume successfully. Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Acquiring lock "cinder-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "cinder-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Acquiring lock "cinder-quobyte-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "cinder-quobyte-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9a60c8-1156-421b-803c-5eb2e23f998e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:01 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 Aug 28 16:23:01 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:02 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" returned: 0 in 0.844s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:02 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612 Aug 28 16:23:02 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:02 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Flow 'volume_create_manager' (dce5ae5d-7470-43e8-8c9d-d4539ed659cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eac748b-c216-44d6-a4a0-463ac5a2b760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" returned: 0 in 0.483s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "cinder-quobyte-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612" released by "delete_volume" :: held 1.418s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eac748b-c216-44d6-a4a0-463ac5a2b760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1052459317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38889e67-cebc-44bc-a99d-60fef9ca367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79874491b0b14720a77344af332cad84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:03Z,use_quota=True,user_id='200d6d87c36e4e31ac9bc13620aa0ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d78af76-1c57-4af4-91a3-c8b83137bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d78af76-1c57-4af4-91a3-c8b83137bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95640c1-94d6-4d38-90f1-35c34ac5176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95640c1-94d6-4d38-90f1-35c34ac5176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38889e67-cebc-44bc-a99d-60fef9ca367d', 'volume_name': 'volume-38889e67-cebc-44bc-a99d-60fef9ca367d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abada6d1-9658-4c72-a6cc-f33e15253dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abada6d1-9658-4c72-a6cc-f33e15253dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7156c0b-4d1a-4b05-b0a8-dde392181aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Volume 38889e67-cebc-44bc-a99d-60fef9ca367d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38889e67-cebc-44bc-a99d-60fef9ca367d', 'volume_size': 1} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1052459317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38889e67-cebc-44bc-a99d-60fef9ca367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79874491b0b14720a77344af332cad84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:03Z,use_quota=True,user_id='200d6d87c36e4e31ac9bc13620aa0ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Creating volume 38889e67-cebc-44bc-a99d-60fef9ca367d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:02 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d 1073741824 Aug 28 16:23:02 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Created reservations ['ef2c6fdc-4566-4326-a875-036a2990d144', 'e70bdb44-00d2-4014-8b2c-3c36e1b2e299', '62fdb372-eb22-42c2-a4c8-7439d304fb1d', '48936fc1-4c67-44df-a9e6-3d9855af9f9e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:03 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:03 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:03 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:03 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d 1073741824" returned: 0 in 0.793s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.576s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Deleted volume successfully. Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-206c3da5-0c2c-464c-b0c7-a18289ee3174 tempest-AbsoluteLimitsTests-444926179 None] Lock "cinder-7fdb07ee-8f1c-49f3-8044-aeaf2d7d3612-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:03 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d Aug 28 16:23:03 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:04 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d" returned: 0 in 0.440s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7156c0b-4d1a-4b05-b0a8-dde392181aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38889e67-cebc-44bc-a99d-60fef9ca367d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c293f-86cf-4271-bfc1-4e2e6aceae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Volume volume-38889e67-cebc-44bc-a99d-60fef9ca367d (38889e67-cebc-44bc-a99d-60fef9ca367d): created successfully Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c293f-86cf-4271-bfc1-4e2e6aceae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Flow 'volume_create_manager' (dce5ae5d-7470-43e8-8c9d-d4539ed659cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1a687c6b-fccb-454a-9595-a729204f3867 tempest-VolumesTransfersV357Test-1568839662 None] Created volume successfully. Aug 28 16:23:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bce365df-59f8-4fbf-a577-641529b86726 tempest-VolumesTransfersV357Test-2130175141 None] Transfer volume completed successfully. Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "cinder-38889e67-cebc-44bc-a99d-60fef9ca367d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-38889e67-cebc-44bc-a99d-60fef9ca367d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "cinder-quobyte-38889e67-cebc-44bc-a99d-60fef9ca367d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-quobyte-38889e67-cebc-44bc-a99d-60fef9ca367d" acquired by "delete_volume" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80776b9-f375-475e-82b2-c909ab063b2d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:07 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d Aug 28 16:23:07 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:07 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d" returned: 0 in 0.478s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:07 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d Aug 28 16:23:07 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:08 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38889e67-cebc-44bc-a99d-60fef9ca367d" returned: 0 in 0.466s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-quobyte-38889e67-cebc-44bc-a99d-60fef9ca367d" released by "delete_volume" :: held 1.002s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Created reservations ['60ac3965-4fbe-4b84-992f-c11bd05d9d38', '09998b97-18c8-465b-b221-c1262beb2c41', '07d2774e-0704-41a6-9539-77d1a0d89540', 'adb69af1-ce23-4fba-b3d5-826530230733'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:08 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:08 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:08 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.394s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Deleted volume successfully. Aug 28 16:23:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a32f9-5240-424c-acad-955c03476291 tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-38889e67-cebc-44bc-a99d-60fef9ca367d-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Flow 'volume_create_manager' (677f9ffe-c68a-4c27-824a-8dec9ceeb6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e0aa00-3d57-4a85-82fe-cdeb34b7e0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e0aa00-3d57-4a85-82fe-cdeb34b7e0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1102193688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080f0bb5-0dc0-445d-9e02-5506387d6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79874491b0b14720a77344af332cad84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:10Z,use_quota=True,user_id='200d6d87c36e4e31ac9bc13620aa0ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba39a0e-72dd-4c98-9ae5-b8eb9bfa5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba39a0e-72dd-4c98-9ae5-b8eb9bfa5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995b8508-b761-40af-876b-e3bec88e11d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995b8508-b761-40af-876b-e3bec88e11d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080f0bb5-0dc0-445d-9e02-5506387d6225', 'volume_name': 'volume-080f0bb5-0dc0-445d-9e02-5506387d6225', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa5f6f-15ba-4d3f-859a-4cd0f3fd529e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa5f6f-15ba-4d3f-859a-4cd0f3fd529e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea720f0-b5f2-4232-87a6-b15e96e9a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Volume 080f0bb5-0dc0-445d-9e02-5506387d6225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080f0bb5-0dc0-445d-9e02-5506387d6225', 'volume_size': 1} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1102193688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080f0bb5-0dc0-445d-9e02-5506387d6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79874491b0b14720a77344af332cad84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:10Z,use_quota=True,user_id='200d6d87c36e4e31ac9bc13620aa0ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Creating volume 080f0bb5-0dc0-445d-9e02-5506387d6225 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:10 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:10 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 1073741824 Aug 28 16:23:10 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Flow 'volume_create_manager' (8d011e30-c265-4458-b9b5-f3614c477f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeae380-4c8b-4fdc-9bb3-3a6056622978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeae380-4c8b-4fdc-9bb3-3a6056622978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-176334877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e40cf8c-3d47-43f8-84ab-d820e6fa87d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3d275343454ada9293247a56fee0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:11Z,use_quota=True,user_id='f6e7717b1d7e4d7882309daa1f63a4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fe8564-a69e-4f9d-b32f-7c1b6f4baaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fe8564-a69e-4f9d-b32f-7c1b6f4baaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3ac5c6-e099-4b56-bce1-bbbb95ee4954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3ac5c6-e099-4b56-bce1-bbbb95ee4954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e40cf8c-3d47-43f8-84ab-d820e6fa87d3', 'volume_name': 'volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5220ae1-50f2-4a8d-b4f2-3246f82ae0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5220ae1-50f2-4a8d-b4f2-3246f82ae0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa37eab9-89f4-4dee-a1c5-eb83e536ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Volume 1e40cf8c-3d47-43f8-84ab-d820e6fa87d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3', 'volume_size': 1} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:10 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 1073741824" returned: 0 in 0.512s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:10 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 Aug 28 16:23:10 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:11 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-176334877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e40cf8c-3d47-43f8-84ab-d820e6fa87d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3d275343454ada9293247a56fee0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:11Z,use_quota=True,user_id='f6e7717b1d7e4d7882309daa1f63a4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Creating volume 1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea720f0-b5f2-4232-87a6-b15e96e9a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080f0bb5-0dc0-445d-9e02-5506387d6225', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c963f1-64a3-4c84-9774-6bdf2360d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:11 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 1073741824 Aug 28 16:23:11 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Volume volume-080f0bb5-0dc0-445d-9e02-5506387d6225 (080f0bb5-0dc0-445d-9e02-5506387d6225): created successfully Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c963f1-64a3-4c84-9774-6bdf2360d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Flow 'volume_create_manager' (677f9ffe-c68a-4c27-824a-8dec9ceeb6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-36469441-3e72-49f0-b1ee-e40db1a24880 tempest-VolumesTransfersV357Test-1568839662 None] Created volume successfully. Aug 28 16:23:12 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 1073741824" returned: 0 in 0.813s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:12 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 Aug 28 16:23:12 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:12 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" returned: 0 in 0.378s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa37eab9-89f4-4dee-a1c5-eb83e536ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f750bc-6571-4b4f-a28a-3281baa2b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:12 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Volume volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 (1e40cf8c-3d47-43f8-84ab-d820e6fa87d3): created successfully Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f750bc-6571-4b4f-a28a-3281baa2b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Flow 'volume_create_manager' (8d011e30-c265-4458-b9b5-f3614c477f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f365ce1d-d501-4ca7-8c24-b4372bc4fc4e tempest-VolumesMetadataTest-16828515 None] Created volume successfully. Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "cinder-080f0bb5-0dc0-445d-9e02-5506387d6225-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-080f0bb5-0dc0-445d-9e02-5506387d6225-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "cinder-quobyte-080f0bb5-0dc0-445d-9e02-5506387d6225" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-quobyte-080f0bb5-0dc0-445d-9e02-5506387d6225" acquired by "delete_volume" :: waited 0.046s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0744b75-bea2-42dd-a661-ab7e966c6788]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:13 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 Aug 28 16:23:13 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:13 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225" returned: 0 in 0.648s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:13 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225 Aug 28 16:23:13 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:14 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-080f0bb5-0dc0-445d-9e02-5506387d6225" returned: 0 in 0.470s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-quobyte-080f0bb5-0dc0-445d-9e02-5506387d6225" released by "delete_volume" :: held 1.198s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Acquiring lock "cinder-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "cinder-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Created reservations ['f8f01b10-dd80-46cf-81e8-5dc9756c07ad', '0a2a41a0-956c-4138-ad30-fb7375de71d5', '24262627-fd6d-47e0-aea4-e3b599fa48ad', 'd1952d0d-25f0-4e2c-86fa-2563be23b1a6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Acquiring lock "cinder-quobyte-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "cinder-quobyte-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" acquired by "delete_volume" :: waited 0.045s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d4132-0fed-4804-9a6a-0a97c82a7c88]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:14 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:14 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:14 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 Aug 28 16:23:14 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:14 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.372s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:14 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Deleted volume successfully. Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c6476dda-bbb4-40f1-8530-fab5c953dccd tempest-VolumesTransfersV357Test-2119008196 None] Lock "cinder-080f0bb5-0dc0-445d-9e02-5506387d6225-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:15 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" returned: 0 in 0.549s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:15 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3 Aug 28 16:23:15 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:15 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "cinder-quobyte-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3" released by "delete_volume" :: held 0.996s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Created reservations ['d010a78b-e799-4c96-9c27-fc166ec684c5', '667793eb-3349-4cd8-a146-6c798c2f5477', 'e37b776a-2338-44d4-a04f-143c4253f07b', 'f0fcfac3-d5fb-45ea-920f-3616370644e6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:15 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:15 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:16 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.524s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:16 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Deleted volume successfully. Aug 28 16:23:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bc16ee6a-ac37-4d2f-b600-3c3fd7ac806e tempest-VolumesMetadataTest-16828515 None] Lock "cinder-1e40cf8c-3d47-43f8-84ab-d820e6fa87d3-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Flow 'volume_create_manager' (bcfb130d-16e2-49ac-b9ab-9836dbf8769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31f6860-5fd7-486a-9072-bcf3a946105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31f6860-5fd7-486a-9072-bcf3a946105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1713202287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53e769-00a0-4fe4-83aa-362d572418e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d5194463a84165848275a064bcd57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:20Z,use_quota=True,user_id='0ad55968060b410c9e43202a31331765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33314a66-d196-43ad-956d-f117a5f957da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33314a66-d196-43ad-956d-f117a5f957da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0a6ce0-b0be-493c-812b-f04d1fbdbe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0a6ce0-b0be-493c-812b-f04d1fbdbe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce53e769-00a0-4fe4-83aa-362d572418e0', 'volume_name': 'volume-ce53e769-00a0-4fe4-83aa-362d572418e0', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70089a53-5c79-42c9-9e37-e764e639abb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70089a53-5c79-42c9-9e37-e764e639abb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc61e949-7746-4f28-b57a-f250c5b94335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Volume ce53e769-00a0-4fe4-83aa-362d572418e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce53e769-00a0-4fe4-83aa-362d572418e0', 'volume_size': 1} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1713202287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce53e769-00a0-4fe4-83aa-362d572418e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d5194463a84165848275a064bcd57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:20Z,use_quota=True,user_id='0ad55968060b410c9e43202a31331765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Creating volume ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:20 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:20 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 1073741824 Aug 28 16:23:20 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:21 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 1073741824" returned: 0 in 0.684s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:21 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:21 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:21 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.325s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc61e949-7746-4f28-b57a-f250c5b94335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce53e769-00a0-4fe4-83aa-362d572418e0', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8471fc13-86da-49ad-8f9f-24abe1857e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Volume volume-ce53e769-00a0-4fe4-83aa-362d572418e0 (ce53e769-00a0-4fe4-83aa-362d572418e0): created successfully Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8471fc13-86da-49ad-8f9f-24abe1857e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Flow 'volume_create_manager' (bcfb130d-16e2-49ac-b9ab-9836dbf8769a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e4df641c-e15f-4941-983d-cf677856bffc tempest-VolumesCloneTest-812569757 None] Created volume successfully. Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Flow 'volume_create_manager' (9bb1e3e6-5c12-4265-856e-116357e27483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5cb996-33e6-4b51-914a-fd44a39b9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5cb996-33e6-4b51-914a-fd44a39b9da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1682047502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbc6f89-c711-475b-991d-7219b8f338aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6770414cb7fc47878e2a67159e9475c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:23Z,use_quota=True,user_id='6c34e8ddf40a45f6a15449606713b483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886f507-8a2d-4f65-ad0f-e3193974ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6886f507-8a2d-4f65-ad0f-e3193974ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be126630-93dc-4c4d-a521-4dcd4bc7ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be126630-93dc-4c4d-a521-4dcd4bc7ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbc6f89-c711-475b-991d-7219b8f338aa', 'volume_name': 'volume-dcbc6f89-c711-475b-991d-7219b8f338aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b994c-354f-4103-ba9a-edb5b80c77f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b994c-354f-4103-ba9a-edb5b80c77f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96274cfe-7d89-4c24-95ff-670e5f245003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:22 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Volume dcbc6f89-c711-475b-991d-7219b8f338aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbc6f89-c711-475b-991d-7219b8f338aa', 'volume_size': 1} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1682047502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbc6f89-c711-475b-991d-7219b8f338aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6770414cb7fc47878e2a67159e9475c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:23Z,use_quota=True,user_id='6c34e8ddf40a45f6a15449606713b483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Creating volume dcbc6f89-c711-475b-991d-7219b8f338aa {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:22 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:22 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa 1073741824 Aug 28 16:23:22 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Flow 'volume_create_manager' (27a02192-6e23-4832-b1cb-74b90520dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132c23a-e053-4f3d-8437-dfc5cc3ba1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132c23a-e053-4f3d-8437-dfc5cc3ba1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1314855930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c419f-f83c-4028-b840-9c9e25d1b13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d5194463a84165848275a064bcd57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ce53e769-00a0-4fe4-83aa-362d572418e0,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:23Z,use_quota=True,user_id='0ad55968060b410c9e43202a31331765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017546fd-34ce-4717-86f2-81bc28494cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017546fd-34ce-4717-86f2-81bc28494cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c6a501-e2be-46a0-afa4-0e0df580aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c6a501-e2be-46a0-afa4-0e0df580aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b94c419f-f83c-4028-b840-9c9e25d1b13b', 'volume_name': 'volume-b94c419f-f83c-4028-b840-9c9e25d1b13b', 'volume_size': 2, 'source_volid': 'ce53e769-00a0-4fe4-83aa-362d572418e0', 'source_volstatus': 'available'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e7ef3-ef4f-41d4-aadb-f4210ad0ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9e7ef3-ef4f-41d4-aadb-f4210ad0ebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215364a3-0896-488f-b3e1-34a448bacab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Volume b94c419f-f83c-4028-b840-9c9e25d1b13b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b94c419f-f83c-4028-b840-9c9e25d1b13b', 'volume_size': 2, 'source_volid': 'ce53e769-00a0-4fe4-83aa-362d572418e0', 'source_volstatus': 'available'} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:23 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa 1073741824" returned: 0 in 0.711s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:23 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa Aug 28 16:23:23 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:24 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa" returned: 0 in 0.434s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.805s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:24 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Cloning volume ce53e769-00a0-4fe4-83aa-362d572418e0 to volume b94c419f-f83c-4028-b840-9c9e25d1b13b Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96274cfe-7d89-4c24-95ff-670e5f245003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbc6f89-c711-475b-991d-7219b8f338aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d65927-71c0-4737-b46e-c715e09083c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Creating offline snapshot 11da6ec4-936f-4764-9fa5-fec0b817a974 of volume ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:23:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Volume volume-dcbc6f89-c711-475b-991d-7219b8f338aa (dcbc6f89-c711-475b-991d-7219b8f338aa): created successfully Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d65927-71c0-4737-b46e-c715e09083c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Flow 'volume_create_manager' (9bb1e3e6-5c12-4265-856e-116357e27483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d6c49-2ef6-45c7-85fd-0e76d8cedbe1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0ba990c3-5419-4b87-b8ae-d945c8fb704a tempest-VolumesNegativeTest-51496401 None] Created volume successfully. Aug 28 16:23:24 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:24 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:24 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.563s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:24 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 1G Aug 28 16:23:24 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:25 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 1G" returned: 0 in 0.750s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53e769-00a0-4fe4-83aa-362d572418e0 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:25 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53e769-00a0-4fe4-83aa-362d572418e0 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:25 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:26 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce53e769-00a0-4fe4-83aa-362d572418e0 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 0.610s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:26 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 is being set with open permissions: ugo+rw Aug 28 16:23:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:26 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:26 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:26 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 0.423s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:26 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info Aug 28 16:23:26 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:27 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info" returned: 0 in 0.410s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:27 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info is being set with open permissions: ugo+rw Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:27 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info Aug 28 16:23:27 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:27 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.info" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] snapshot: 11da6ec4-936f-4764-9fa5-fec0b817a974, volume: b94c419f-f83c-4028-b840-9c9e25d1b13b, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b884c9c-02ea-478a-9668-ab9e488254c4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:27 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:27 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:28 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 0.708s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce53e769-00a0-4fe4-83aa-362d572418e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[869ac454-8fbb-4c00-a684-ffdf334609de]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:28 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:28 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:28 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:23:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:28 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b Aug 28 16:23:28 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:31 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:31 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:32 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.931s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:23:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:23:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:23:35 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b" returned: 0 in 7.147s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:35 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:23:35 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Converted 1024.00 MB image at 143.18 MB/s Aug 28 16:23:35 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b is being set with open permissions: ugo+rw Aug 28 16:23:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:36 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b Aug 28 16:23:36 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:36 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b" returned: 0 in 0.306s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" released by "_copy_volume_from_snapshot" :: held 8.862s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-quobyte-11da6ec4-936f-4764-9fa5-fec0b817a974" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-11da6ec4-936f-4764-9fa5-fec0b817a974" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Deleting offline snapshot 11da6ec4-936f-4764-9fa5-fec0b817a974 of volume ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] snapshot_file for this snap is: volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a14b9b9-6947-4344-91e8-a5856ee611ba]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:36 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=82,cinder:DELETE=6,cinder:SELECT=60,cinder:INSERT=14 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:23:36 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:36 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:37 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 1.021s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce53e769-00a0-4fe4-83aa-362d572418e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:23:37 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398e576-d7b7-4f3b-8165-6c6230d97072]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:37 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:37 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:38 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.911s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:38 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:38 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:38 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 0.485s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:38 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974 Aug 28 16:23:38 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:39 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0.11da6ec4-936f-4764-9fa5-fec0b817a974" returned: 0 in 0.296s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-11da6ec4-936f-4764-9fa5-fec0b817a974" released by "_delete_snapshot" :: held 2.906s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.285s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215364a3-0896-488f-b3e1-34a448bacab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94c419f-f83c-4028-b840-9c9e25d1b13b', 'volume_size': 2, 'source_volid': 'ce53e769-00a0-4fe4-83aa-362d572418e0', 'source_volstatus': 'available'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025df9fb-fe9a-4e90-b44f-9fe87fd747ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:39 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Volume volume-b94c419f-f83c-4028-b840-9c9e25d1b13b (b94c419f-f83c-4028-b840-9c9e25d1b13b): created successfully Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025df9fb-fe9a-4e90-b44f-9fe87fd747ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Flow 'volume_create_manager' (27a02192-6e23-4832-b1cb-74b90520dea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-055f4af7-c224-48ee-8a7b-8a4b0b601603 tempest-VolumesCloneTest-812569757 None] Created volume successfully. Aug 28 16:23:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-1c8769b7-8ee4-484c-99ff-c4223c4c3a3b req-5d796ed7-78d3-4c6c-a467-d19ead631dfb tempest-AttachVolumeTestJSON-1175656600 None] Terminate volume connection completed successfully. Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-1c8769b7-8ee4-484c-99ff-c4223c4c3a3b req-5d796ed7-78d3-4c6c-a467-d19ead631dfb tempest-AttachVolumeTestJSON-1175656600 None] Deleting attachment 660ecfb0-d235-4b2a-b907-a4c615c011c3. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-b94c419f-f83c-4028-b840-9c9e25d1b13b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "cinder-b94c419f-f83c-4028-b840-9c9e25d1b13b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9c475-bb55-4320-9c1f-137876bc57f1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:40 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b Aug 28 16:23:40 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:41 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:41 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b Aug 28 16:23:41 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:41 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b94c419f-f83c-4028-b840-9c9e25d1b13b" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-b94c419f-f83c-4028-b840-9c9e25d1b13b" released by "delete_volume" :: held 0.944s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Created reservations ['dc5c2e85-9758-42a6-ae59-6432e0ba57d9', '2aee8f6e-60fe-469f-8422-878311e23679', '476c3130-67b6-4c55-9d14-c67eb2ebec97', '0fb02293-2a01-4a76-bf33-a218342b98c9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:41 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:41 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:42 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Deleted volume successfully. Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-52e1036e-ce57-4a83-9842-b6d2ee8253fd tempest-VolumesCloneTest-812569757 None] Lock "cinder-b94c419f-f83c-4028-b840-9c9e25d1b13b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-ce53e769-00a0-4fe4-83aa-362d572418e0-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "cinder-ce53e769-00a0-4fe4-83aa-362d572418e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=76,cinder:SELECT=67,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Acquiring lock "cinder-quobyte-ce53e769-00a0-4fe4-83aa-362d572418e0" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-ce53e769-00a0-4fe4-83aa-362d572418e0" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea246578-90ef-4084-a8f8-b5d89d1d67dd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:43 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:43 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:43 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.409s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:43 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0 Aug 28 16:23:43 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:43 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce53e769-00a0-4fe4-83aa-362d572418e0" returned: 0 in 0.323s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "cinder-quobyte-ce53e769-00a0-4fe4-83aa-362d572418e0" released by "delete_volume" :: held 0.847s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Created reservations ['5922c21b-7923-4c0f-b256-3e5140e2b7b2', 'a87705aa-cd4b-4057-ab0e-7aea01e75db4', '6dd57fbe-dd08-4a19-b93b-b09a4085ed19', '4fcbd469-ef8b-4e08-93e8-af2ca7000d10'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:44 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:44 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:44 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Deleted volume successfully. Aug 28 16:23:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-338c31d4-da64-45e8-aed3-9953f260568a tempest-VolumesCloneTest-812569757 None] Lock "cinder-ce53e769-00a0-4fe4-83aa-362d572418e0-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Flow 'volume_create_manager' (6d59c305-48db-4fef-bca7-6d5e62284905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde5f80c-7e7d-4d29-b278-00b5de645079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde5f80c-7e7d-4d29-b278-00b5de645079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-337869504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25886b94-f7c1-4c4e-89d3-bacb3bd557cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c054009f90468f9da34bd2f5599f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:49Z,use_quota=True,user_id='82861aa5411b458aaa474e81404af6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014ba95c-b56b-4c70-972d-966c89264027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014ba95c-b56b-4c70-972d-966c89264027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda300f5-5bf7-47a8-8ad2-b69c068dc44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda300f5-5bf7-47a8-8ad2-b69c068dc44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25886b94-f7c1-4c4e-89d3-bacb3bd557cd', 'volume_name': 'volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882521f-3918-4978-9e44-84c597266c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882521f-3918-4978-9e44-84c597266c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d4ee0a-4257-431d-8732-e37b9a351c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:49 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Volume 25886b94-f7c1-4c4e-89d3-bacb3bd557cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd', 'volume_size': 1} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-337869504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25886b94-f7c1-4c4e-89d3-bacb3bd557cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01c054009f90468f9da34bd2f5599f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:23:49Z,use_quota=True,user_id='82861aa5411b458aaa474e81404af6f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Creating volume 25886b94-f7c1-4c4e-89d3-bacb3bd557cd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:23:49 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:23:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:49 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd 1073741824 Aug 28 16:23:49 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:50 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd 1073741824" returned: 0 in 0.815s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:50 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd Aug 28 16:23:50 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:50 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" returned: 0 in 0.488s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d4ee0a-4257-431d-8732-e37b9a351c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfedd1e-b6a3-4b4f-b1aa-84ae0892599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:23:50 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Volume volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd (25886b94-f7c1-4c4e-89d3-bacb3bd557cd): created successfully Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfedd1e-b6a3-4b4f-b1aa-84ae0892599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:23:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Flow 'volume_create_manager' (6d59c305-48db-4fef-bca7-6d5e62284905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:23:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2dfca517-eff8-46c4-b9a3-8c70505d0a6b tempest-AttachVolumeShelveTestJSON-1100036726 None] Created volume successfully. Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Acquiring lock "cinder-dcbc6f89-c711-475b-991d-7219b8f338aa-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "cinder-dcbc6f89-c711-475b-991d-7219b8f338aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Acquiring lock "cinder-quobyte-dcbc6f89-c711-475b-991d-7219b8f338aa" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "cinder-quobyte-dcbc6f89-c711-475b-991d-7219b8f338aa" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[581ae8ee-0ba3-4620-aedc-65dd0402fdc5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:23:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:55 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa Aug 28 16:23:55 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:56 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa" returned: 0 in 0.767s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:56 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa Aug 28 16:23:56 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:56 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dcbc6f89-c711-475b-991d-7219b8f338aa" returned: 0 in 0.559s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "cinder-quobyte-dcbc6f89-c711-475b-991d-7219b8f338aa" released by "delete_volume" :: held 1.383s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:23:56 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Created reservations ['f0fc176b-31e4-40be-b085-d37225778fc9', 'f483e833-e169-45c1-a174-e1874200c77d', '49ba1ec2-20ed-440d-a1d2-f4ff8660018d', 'f9764e84-0c0d-4cda-810a-a108fb432fb5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:23:57 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:23:57 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:23:57 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.481s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:23:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Deleted volume successfully. Aug 28 16:23:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d3e02b81-baeb-490c-b901-1674f93c181f tempest-VolumesNegativeTest-51496401 None] Lock "cinder-dcbc6f89-c711-475b-991d-7219b8f338aa-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Flow 'volume_create_manager' (111c00b5-dc0b-4fa3-a622-b1301aeea84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a618a1a9-995b-4752-9163-57cf96527269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a618a1a9-995b-4752-9163-57cf96527269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-748217392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6405e73e-487d-4269-a7f8-aece8a7f1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464996e870744de69dfdf66798123b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:03Z,use_quota=True,user_id='4ccbb90d3d7b4e17a4ceefe4632036f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7968c0bb-1b9f-47fc-ba09-23ad45dc9098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7968c0bb-1b9f-47fc-ba09-23ad45dc9098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f84dd4-0089-4b22-ba3e-15358d5cf1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f84dd4-0089-4b22-ba3e-15358d5cf1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6405e73e-487d-4269-a7f8-aece8a7f1074', 'volume_name': 'volume-6405e73e-487d-4269-a7f8-aece8a7f1074', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9790f940-4844-47fd-9c28-7c07a1d9c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9790f940-4844-47fd-9c28-7c07a1d9c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9032af38-161b-4430-8145-317b0242dafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Volume 6405e73e-487d-4269-a7f8-aece8a7f1074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6405e73e-487d-4269-a7f8-aece8a7f1074', 'volume_size': 1} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-748217392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6405e73e-487d-4269-a7f8-aece8a7f1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='464996e870744de69dfdf66798123b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:03Z,use_quota=True,user_id='4ccbb90d3d7b4e17a4ceefe4632036f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Creating volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:03 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:03 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 1073741824 Aug 28 16:24:03 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (1c875a1f-a481-49fd-9520-c262db38ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2259bf64-f8a5-4199-bddb-4d2f539ce75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2259bf64-f8a5-4199-bddb-4d2f539ce75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1012378748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a99693c-ade0-4982-9224-e907a332df95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:03Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceea288c-ae26-43d7-83ea-1195aa35d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceea288c-ae26-43d7-83ea-1195aa35d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8044f-f9bb-46d5-aad7-7ef5bc235504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f8044f-f9bb-46d5-aad7-7ef5bc235504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a99693c-ade0-4982-9224-e907a332df95', 'volume_name': 'volume-1a99693c-ade0-4982-9224-e907a332df95', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bd0532-8f35-4da7-bd2a-e9f8bde3d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bd0532-8f35-4da7-bd2a-e9f8bde3d119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f432eb-bede-4e0b-997b-8092c2e4848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Volume 1a99693c-ade0-4982-9224-e907a332df95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a99693c-ade0-4982-9224-e907a332df95', 'volume_size': 1} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:03 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 1073741824" returned: 0 in 0.545s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:03 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 Aug 28 16:24:03 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:03 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074" returned: 0 in 0.329s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1012378748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a99693c-ade0-4982-9224-e907a332df95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:03Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Creating volume 1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:03 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9032af38-161b-4430-8145-317b0242dafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6405e73e-487d-4269-a7f8-aece8a7f1074', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:03 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 1073741824 Aug 28 16:24:03 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854e73e3-2050-4e50-b6ce-0a9d3dab2d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Volume volume-6405e73e-487d-4269-a7f8-aece8a7f1074 (6405e73e-487d-4269-a7f8-aece8a7f1074): created successfully Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854e73e3-2050-4e50-b6ce-0a9d3dab2d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Flow 'volume_create_manager' (111c00b5-dc0b-4fa3-a622-b1301aeea84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6037cc66-7ed5-4727-8c04-1cd1a7abbc2d tempest-VolumesSnapshotListTestJSON-1012047149 None] Created volume successfully. Aug 28 16:24:04 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 1073741824" returned: 0 in 0.673s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:04 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 Aug 28 16:24:04 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:04 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f432eb-bede-4e0b-997b-8092c2e4848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a99693c-ade0-4982-9224-e907a332df95', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be4645c-6e66-4a37-b055-5250c83c7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Volume volume-1a99693c-ade0-4982-9224-e907a332df95 (1a99693c-ade0-4982-9224-e907a332df95): created successfully Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be4645c-6e66-4a37-b055-5250c83c7120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (1c875a1f-a481-49fd-9520-c262db38ed25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-37dda386-63e5-436b-9ab8-fd9977faa9db tempest-VolumesSnapshotTestJSON-131510247 None] Created volume successfully. Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Creating offline snapshot 76ae71a7-7900-4122-a5d6-d979daf5b26a of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106799c-a3a9-4263-a061-df50deca8e72]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:05 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 Aug 28 16:24:05 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:05 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074" returned: 0 in 0.406s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:05 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a 1G Aug 28 16:24:05 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-a1316513-fc0a-4ae0-9b43-9255155ba063 req-2caa79b0-4b74-4707-905d-e0e204d7960c tempest-AttachVolumeShelveTestJSON-1100036726 None] No connector for attachment 047c03c2-a3e1-4767-966e-83ff4a3c241e; skipping storage backend terminate_connection call. {{(pid=86193) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-a1316513-fc0a-4ae0-9b43-9255155ba063 req-2caa79b0-4b74-4707-905d-e0e204d7960c tempest-AttachVolumeShelveTestJSON-1100036726 None] Deleting attachment 047c03c2-a3e1-4767-966e-83ff4a3c241e. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:24:06 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a 1G" returned: 0 in 0.465s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:06 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:06 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:06 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:06 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a is being set with open permissions: ugo+rw Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:06 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:06 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:06 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 0.329s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:06 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info Aug 28 16:24:06 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:07 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:07 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info is being set with open permissions: ugo+rw Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:07 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info Aug 28 16:24:07 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:07 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.info" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.793s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Creating offline snapshot a38e6015-8590-4ce7-8bd5-a6ca3bb9360d of volume 1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c91792fc-dcc6-4353-9697-446297332142 tempest-VolumesSnapshotListTestJSON-1012047149 None] Create snapshot completed successfully Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9dd59-df78-4f17-a426-7856392bfe52]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:07 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 Aug 28 16:24:07 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:07 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95" returned: 0 in 0.482s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:07 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d 1G Aug 28 16:24:07 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:08 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d 1G" returned: 0 in 0.645s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a99693c-ade0-4982-9224-e907a332df95 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:08 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a99693c-ade0-4982-9224-e907a332df95 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d Aug 28 16:24:08 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:09 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a99693c-ade0-4982-9224-e907a332df95 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" returned: 0 in 0.462s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:09 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d is being set with open permissions: ugo+rw Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:09 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d Aug 28 16:24:09 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:09 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" returned: 0 in 0.323s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:09 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info Aug 28 16:24:09 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:09 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:09 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info is being set with open permissions: ugo+rw Aug 28 16:24:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:09 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info Aug 28 16:24:09 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:10 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.info" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.448s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Creating offline snapshot ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd742d2-e816-49b2-9616-5efc88fa2642]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ccfe7bcc-77f2-405a-80e5-a23954a5e244 tempest-VolumesSnapshotTestJSON-131510247 None] Create snapshot completed successfully Aug 28 16:24:10 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:10 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:10 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 0.509s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:10 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 1G Aug 28 16:24:10 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:11 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Deleting offline snapshot a38e6015-8590-4ce7-8bd5-a6ca3bb9360d of volume 1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] snapshot_file for this snap is: volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 1G" returned: 0 in 0.755s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[98568949-53fc-4beb-8ab1-ead3aec25569]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:11 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:11 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:11 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d Aug 28 16:24:11 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:11 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.551s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:12 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 is being set with open permissions: ugo+rw Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:12 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" returned: 0 in 0.574s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a99693c-ade0-4982-9224-e907a332df95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:12 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:12 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a5f3e5-329b-4633-b3a6-e05d4fb621ba]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:12 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 Aug 28 16:24:12 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:12 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.524s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2edebd20-2ef4-46ed-8999-004cb13b1f9d tempest-VolumesSnapshotListTestJSON-1012047149 None] Create snapshot completed successfully Aug 28 16:24:12 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95" returned: 0 in 0.575s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:12 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d Aug 28 16:24:12 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Creating offline snapshot be4a278f-7f8c-4974-8b1a-1e9a44698d78 of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8acd318-2d7f-4399-a0ba-7d0382cd0f5e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:13 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" returned: 0 in 0.490s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:13 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d Aug 28 16:24:13 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:13 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:13 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:13 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95.a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" returned: 0 in 0.418s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d" released by "_delete_snapshot" :: held 2.267s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" released by "delete_snapshot" :: held 2.308s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:13 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.593s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:13 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 1G Aug 28 16:24:13 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['8c02794b-e50f-4dd4-9cd1-22641be6d34b', '721ea5dd-3c28-449c-bdd0-ba84842873fe', '11b94cdf-2a22-46df-bd2d-a3262784daf4', '9183cb88-5312-44cc-b152-b2a5bf6bbfdb'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Delete snapshot completed successfully. Aug 28 16:24:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6985a4b1-524d-46b2-ac4f-6ab24b507df4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-a38e6015-8590-4ce7-8bd5-a6ca3bb9360d-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:14 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 1G" returned: 0 in 0.677s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:14 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 Aug 28 16:24:14 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:14 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78" returned: 0 in 0.364s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:14 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 is being set with open permissions: ugo+rw Aug 28 16:24:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:14 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 Aug 28 16:24:14 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:15 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78" returned: 0 in 0.385s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-57d025d4-db93-4c8c-af84-b245ba3f8a78 tempest-VolumesSnapshotListTestJSON-1012047149 None] Create snapshot completed successfully Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (dec2eed7-7a96-4736-b771-5da2085f5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf13ffe-601e-4961-8067-1ef8d434e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf13ffe-601e-4961-8067-1ef8d434e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-807620681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384c19af-ef8d-4d06-ab2c-9a1b968b5a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:15Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510f319a-9518-4856-96e9-4b7f80b1815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510f319a-9518-4856-96e9-4b7f80b1815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f067054-1e34-4b6f-b012-8f2c4e3aa6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f067054-1e34-4b6f-b012-8f2c4e3aa6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384c19af-ef8d-4d06-ab2c-9a1b968b5a2c', 'volume_name': 'volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71da896-ae92-4730-81c8-0ca6d34f35f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b71da896-ae92-4730-81c8-0ca6d34f35f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563de17b-1104-4841-bf54-4edb8c271016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:15 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Volume 384c19af-ef8d-4d06-ab2c-9a1b968b5a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c', 'volume_size': 1} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-807620681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384c19af-ef8d-4d06-ab2c-9a1b968b5a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:15Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Creating volume 384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:15 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:15 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c 1073741824 Aug 28 16:24:15 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:16 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c 1073741824" returned: 0 in 0.558s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:16 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:16 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:16 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563de17b-1104-4841-bf54-4edb8c271016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c4a1d9-61f4-4e7c-9f8a-736e96e25f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:16 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Volume volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c (384c19af-ef8d-4d06-ab2c-9a1b968b5a2c): created successfully Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c4a1d9-61f4-4e7c-9f8a-736e96e25f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:16 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (dec2eed7-7a96-4736-b771-5da2085f5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-84d5f09f-e172-4481-952e-5735348f7771 tempest-VolumesSnapshotTestJSON-131510247 None] Created volume successfully. Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-be4a278f-7f8c-4974-8b1a-1e9a44698d78-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-be4a278f-7f8c-4974-8b1a-1e9a44698d78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" acquired by "delete_snapshot" :: waited 0.087s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-be4a278f-7f8c-4974-8b1a-1e9a44698d78" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-be4a278f-7f8c-4974-8b1a-1e9a44698d78" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Deleting offline snapshot be4a278f-7f8c-4974-8b1a-1e9a44698d78 of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] snapshot_file for this snap is: volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8316cd5-ad7d-4e3e-949d-a7342132202b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Creating offline snapshot 7903dbd0-c529-4a73-bbde-5940ceeb6e8c of volume 384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61987bd-55fb-4b5a-83ce-aedf1038a7ae]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:18 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 Aug 28 16:24:18 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:18 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:18 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:18 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78" returned: 0 in 0.834s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e10dba1-118e-498c-99d9-e8c3579e65bf]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:18 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.806s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:18 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c 1G Aug 28 16:24:18 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:18 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:18 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:19 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.563s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:19 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 Aug 28 16:24:19 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:19 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c 1G" returned: 0 in 0.800s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:19 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:19 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:20 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.539s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:20 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c is being set with open permissions: ugo+rw Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:20 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:20 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:20 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78" returned: 0 in 1.065s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:20 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78 Aug 28 16:24:20 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:20 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.379s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:20 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info Aug 28 16:24:20 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:20 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.be4a278f-7f8c-4974-8b1a-1e9a44698d78" returned: 0 in 0.476s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-be4a278f-7f8c-4974-8b1a-1e9a44698d78" released by "_delete_snapshot" :: held 3.160s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" released by "delete_snapshot" :: held 3.227s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Created reservations ['480f373e-6c7b-428e-aa21-e564926b9a5e', 'c6be82cb-4037-472a-9ef7-d6e3a1686080', '3225081f-aca2-4c19-be44-234fd4f9f4bf', '05c4d718-4219-44ae-84e8-d44d39e796af'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:21 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info" returned: 0 in 0.600s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:21 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info is being set with open permissions: ugo+rw Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:21 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info Aug 28 16:24:21 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Delete snapshot completed successfully. Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-020ab686-cafb-4d62-91cc-bf23c939598d tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-be4a278f-7f8c-4974-8b1a-1e9a44698d78-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:21 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.info" returned: 0 in 0.614s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cd9ff47f-94c4-43ba-a8d0-f2ca591d1a64 tempest-VolumesSnapshotTestJSON-131510247 None] Create snapshot completed successfully Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Deleting offline snapshot ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] snapshot_file for this snap is: volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d8b31-81cf-4a6e-a37a-4aa12786f6e3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:22 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:22 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:23 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.602s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b5ed27-9bd1-4725-bb6e-b960a5c7ad52]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (c984076f-dedc-40a5-9dbd-b4c8a6823766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07503af-58d0-492f-a22a-8a9a760dc1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07503af-58d0-492f-a22a-8a9a760dc1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-833795343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a7d598-ea2c-4352-add2-73442f941bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7903dbd0-c529-4a73-bbde-5940ceeb6e8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:23Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5957e9-e356-41eb-bc6f-6f34f4953728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5957e9-e356-41eb-bc6f-6f34f4953728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b897833a-be7d-46bd-b46a-e9da231d902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b897833a-be7d-46bd-b46a-e9da231d902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67a7d598-ea2c-4352-add2-73442f941bfd', 'volume_name': 'volume-67a7d598-ea2c-4352-add2-73442f941bfd', 'volume_size': 2, 'snapshot_id': '7903dbd0-c529-4a73-bbde-5940ceeb6e8c'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1030ef-eafd-4f08-817f-1ff9c746f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:23 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:23 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1030ef-eafd-4f08-817f-1ff9c746f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d7fb4b-1aac-41db-b0d2-dfbe58ea5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Volume 67a7d598-ea2c-4352-add2-73442f941bfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67a7d598-ea2c-4352-add2-73442f941bfd', 'volume_size': 2, 'snapshot_id': '7903dbd0-c529-4a73-bbde-5940ceeb6e8c'} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-67a7d598-ea2c-4352-add2-73442f941bfd" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-67a7d598-ea2c-4352-add2-73442f941bfd" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Creating volume 67a7d598-ea2c-4352-add2-73442f941bfd from snapshot 7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] snapshot: 7903dbd0-c529-4a73-bbde-5940ceeb6e8c, volume: 67a7d598-ea2c-4352-add2-73442f941bfd, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84496b-36fb-4fc7-aa53-49e69a4169a4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:23 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:23 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:23 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 0.591s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:23 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:23 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:24 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.600s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[74000936-8414-4b81-926c-56e1838bcafd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:24 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:24 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:24 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 1.027s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:24 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9 Aug 28 16:24:24 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:24 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.831s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:24:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:25 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd Aug 28 16:24:25 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:25 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" returned: 0 in 0.979s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9" released by "_delete_snapshot" :: held 3.419s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" released by "delete_snapshot" :: held 3.477s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:26 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Created reservations ['fec51895-a0ec-4adb-a002-be5b614c6192', 'fcbabf5e-0524-49a5-af8b-e029286c27c7', '4a10b416-3a75-4afb-8f67-b9b5a36e9670', '62ca33a7-8170-4f48-8db8-8300291d434b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Delete snapshot completed successfully. Aug 28 16:24:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ee9e4aea-cc3a-41c9-820b-64bdd7c50dae tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-ba3a0c62-ff4b-44b1-8201-8d9f52df93e9-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-76ae71a7-7900-4122-a5d6-d979daf5b26a-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-76ae71a7-7900-4122-a5d6-d979daf5b26a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-76ae71a7-7900-4122-a5d6-d979daf5b26a" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-76ae71a7-7900-4122-a5d6-d979daf5b26a" acquired by "_delete_snapshot" :: waited 0.090s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Deleting offline snapshot 76ae71a7-7900-4122-a5d6-d979daf5b26a of volume 6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] snapshot_file for this snap is: volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187567c-b1bd-406e-8a46-fc0da06be726]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:27 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:27 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:29 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 1.908s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6405e73e-487d-4269-a7f8-aece8a7f1074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05146e-4079-43ce-a430-4d967b6d569a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:29 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 Aug 28 16:24:29 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:30 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074" returned: 0 in 1.460s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:30 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:30 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:31 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:31 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:32 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 2.053s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:32 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 1.423s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:24:32 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a Aug 28 16:24:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:24:32 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:33 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074.76ae71a7-7900-4122-a5d6-d979daf5b26a" returned: 0 in 0.926s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-76ae71a7-7900-4122-a5d6-d979daf5b26a" released by "_delete_snapshot" :: held 6.743s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" released by "delete_snapshot" :: held 6.869s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:34 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Created reservations ['c67dce9a-5946-4ecd-9c74-168dfc9230ae', '631d387b-cb40-480d-b696-f91a42a0a4b0', '9077c47c-d4ed-4f84-a6ef-35ce49cd1d5a', '78fe2c12-d2be-4091-8f4b-c5b9c7c24d5e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Delete snapshot completed successfully. Aug 28 16:24:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1e0e17d-d58e-48cf-b28f-80de5a89e691 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-76ae71a7-7900-4122-a5d6-d979daf5b26a-delete_snapshot" released by "delete_snapshot" :: held 7.507s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:34 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd" returned: 0 in 9.944s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:34 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:24:34 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Converted 1024.00 MB image at 102.96 MB/s Aug 28 16:24:34 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd is being set with open permissions: ugo+rw Aug 28 16:24:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:34 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd Aug 28 16:24:34 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-6405e73e-487d-4269-a7f8-aece8a7f1074-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-6405e73e-487d-4269-a7f8-aece8a7f1074-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:35 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd" returned: 0 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" released by "_copy_volume_from_snapshot" :: held 11.906s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ccf73-e206-45fc-950c-445d078b806a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-67a7d598-ea2c-4352-add2-73442f941bfd" released by "_create_volume_from_snapshot" :: held 12.074s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.095s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d7fb4b-1aac-41db-b0d2-dfbe58ea5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a7d598-ea2c-4352-add2-73442f941bfd', 'volume_size': 2, 'snapshot_id': '7903dbd0-c529-4a73-bbde-5940ceeb6e8c'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eece9c3-e9c3-4be0-9285-66e806fe29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:35 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Volume volume-67a7d598-ea2c-4352-add2-73442f941bfd (67a7d598-ea2c-4352-add2-73442f941bfd): created successfully Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eece9c3-e9c3-4be0-9285-66e806fe29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (c984076f-dedc-40a5-9dbd-b4c8a6823766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-88df01e7-a635-4c8e-80f3-01c6af1556e5 tempest-VolumesSnapshotTestJSON-131510247 None] Created volume successfully. Aug 28 16:24:35 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 Aug 28 16:24:35 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:35 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074" returned: 0 in 0.493s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:35 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074 Aug 28 16:24:35 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:36 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6405e73e-487d-4269-a7f8-aece8a7f1074" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-quobyte-6405e73e-487d-4269-a7f8-aece8a7f1074" released by "delete_volume" :: held 0.858s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Created reservations ['176bec0f-cc00-4e43-8922-2fde708d0845', '5b36e77a-17ef-49fd-b25b-cc6687b3e6ed', 'fbe8a759-e9d3-48c6-9381-ae9de60194d7', 'd7382b8a-54f5-4ab4-a558-0daeaacb560a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:36 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:36 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:36 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Deleted volume successfully. Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cb219fbc-df8b-4e70-a783-3bfdbb8c3078 tempest-VolumesSnapshotListTestJSON-1012047149 None] Lock "cinder-6405e73e-487d-4269-a7f8-aece8a7f1074-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-67a7d598-ea2c-4352-add2-73442f941bfd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-67a7d598-ea2c-4352-add2-73442f941bfd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=84,cinder:SELECT=79,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f21c3d-81be-4053-8a9b-47d0dd6fa14d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:36 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd Aug 28 16:24:36 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:37 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd" returned: 0 in 0.428s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:37 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd Aug 28 16:24:37 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:37 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-67a7d598-ea2c-4352-add2-73442f941bfd" returned: 0 in 0.265s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-67a7d598-ea2c-4352-add2-73442f941bfd" released by "delete_volume" :: held 0.739s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['46005e35-db35-4115-a56e-c30aa4fe7c04', '50240c6a-7f4c-47c8-998f-a24330fb76f4', '3ade52aa-900b-4937-b9af-015356ec9705', '1f057f23-680d-46f8-bcd9-a8d02a29bb12'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:37 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:37 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Deleting offline snapshot 7903dbd0-c529-4a73-bbde-5940ceeb6e8c of volume 384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:38 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] snapshot_file for this snap is: volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.402s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Deleted volume successfully. Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a156dbe-2a37-4f86-84c0-ea19a709cc3d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f32138c4-3ec0-461a-b163-eec1c39e01a7 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-67a7d598-ea2c-4352-add2-73442f941bfd-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:38 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:38 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:38 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.418s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1966e3-c219-4e27-83bd-4ae37ee01666]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:38 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:38 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:39 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.609s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:39 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:39 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:39 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:39 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c Aug 28 16:24:39 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:40 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c.7903dbd0-c529-4a73-bbde-5940ceeb6e8c" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-7903dbd0-c529-4a73-bbde-5940ceeb6e8c" released by "_delete_snapshot" :: held 2.002s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" released by "delete_snapshot" :: held 2.048s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Flow 'volume_create_manager' (9b822982-0f48-4990-b076-6b2a4357fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdcc7ad-36c6-4559-9dbc-42ce6e060a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdcc7ad-36c6-4559-9dbc-42ce6e060a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-800883956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9b0c33-658f-422f-86be-b81a5a3d1f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434c0fcf85e241728de52f7949b1d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:40Z,use_quota=True,user_id='25bbd51dcebe4cbda879b2c5603423b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf6dac9-c048-4b66-a6c0-947e553347ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf6dac9-c048-4b66-a6c0-947e553347ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3a7921-d510-4fb9-96e5-e0108bb7c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3a7921-d510-4fb9-96e5-e0108bb7c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9b0c33-658f-422f-86be-b81a5a3d1f6b', 'volume_name': 'volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b', 'volume_size': 2}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc0872a-755a-4e36-a172-b435a57b2f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc0872a-755a-4e36-a172-b435a57b2f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4accae95-ee1a-45f9-bddd-85b2480de241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Volume cb9b0c33-658f-422f-86be-b81a5a3d1f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b', 'volume_size': 2} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-800883956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9b0c33-658f-422f-86be-b81a5a3d1f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434c0fcf85e241728de52f7949b1d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:40Z,use_quota=True,user_id='25bbd51dcebe4cbda879b2c5603423b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Creating volume cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:40 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b 2147483648 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:40 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b 2147483648 Aug 28 16:24:40 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['592c1a03-4862-46db-b382-23a6d273c0d2', '0313f7fa-8ab1-4680-8789-590f22c002aa', '374acaf6-c301-44d2-819b-a959a93b6c3a', '41fd9ffa-ea58-4ff9-b50c-45250795bc67'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Delete snapshot completed successfully. Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91ab5d78-59f0-40b6-af1b-442761cbcf62 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-7903dbd0-c529-4a73-bbde-5940ceeb6e8c-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:40 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b 2147483648" returned: 0 in 0.508s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:40 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b Aug 28 16:24:40 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:41 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" returned: 0 in 0.310s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4accae95-ee1a-45f9-bddd-85b2480de241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b', 'volume_size': 2}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e049952-a2d2-484d-b0d1-3a737e7b5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:41 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Volume volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b (cb9b0c33-658f-422f-86be-b81a5a3d1f6b): created successfully Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e049952-a2d2-484d-b0d1-3a737e7b5d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Flow 'volume_create_manager' (9b822982-0f48-4990-b076-6b2a4357fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4bc8b067-7e4f-4768-b7de-65831026d132 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Created volume successfully. Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8369ea4c-5f78-49c5-b190-dcc20c6fb3c8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:41 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:41 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:42 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.433s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:42 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c Aug 28 16:24:42 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:42 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" returned: 0 in 0.342s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c" released by "delete_volume" :: held 0.844s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['ee9374cf-17de-46ed-9933-532fd26443cf', '232ee291-f39a-44cb-a1fa-dd184eaf1a98', '4019b84d-a1c5-42b4-8971-5fb0e705aef7', '5567c8a1-7410-4b74-b29a-ecd6e6d9de51'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:42 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:42 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Creating offline snapshot 4d70e29c-b31d-453b-b7de-bb913d7d9fd7 of volume cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e13f4-3deb-497e-aae5-7cead86c3c07]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:43 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.503s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Deleted volume successfully. Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=87,cinder:INSERT=27,cinder:UPDATE=90,cinder:DELETE=10 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:24:43 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b Aug 28 16:24:43 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a16efe-aa81-4533-a8c6-3592a4eb7b3d tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-384c19af-ef8d-4d06-ab2c-9a1b968b5a2c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:43 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (91d0ffbe-4d14-487c-8896-15fbcffa1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21e092d-cfa6-4051-bc51-be7bae546e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" returned: 0 in 0.722s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 2G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b21e092d-cfa6-4051-bc51-be7bae546e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749567626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72ae3d9-8db3-40ef-ae7a-c948dd989656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:44Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:43 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 2G Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365cab10-53da-4039-9b5f-d797842a1a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:43 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365cab10-53da-4039-9b5f-d797842a1a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8f4ff-9c36-4a4a-960e-9c33221ffcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8f4ff-9c36-4a4a-960e-9c33221ffcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72ae3d9-8db3-40ef-ae7a-c948dd989656', 'volume_name': 'volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a44f831-0b82-4776-95e0-9c2ee1a0eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a44f831-0b82-4776-95e0-9c2ee1a0eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbf52f3-7fac-4b90-8b0c-dfaf533b19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:43 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Volume e72ae3d9-8db3-40ef-ae7a-c948dd989656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656', 'volume_size': 1} Aug 28 16:24:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:44 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 2G" returned: 0 in 0.482s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:44 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 Aug 28 16:24:44 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:44 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7" returned: 0 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:44 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 is being set with open permissions: ugo+rw Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:44 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 Aug 28 16:24:44 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:44 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7" returned: 0 in 0.327s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:44 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info Aug 28 16:24:44 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:45 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info" returned: 0 in 0.271s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:45 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info is being set with open permissions: ugo+rw Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:45 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info Aug 28 16:24:45 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:45 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.info" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749567626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72ae3d9-8db3-40ef-ae7a-c948dd989656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:44Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Creating volume e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:45 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:45 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 1073741824 Aug 28 16:24:45 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c7dd7a19-aef2-40fa-9229-1f12e562a18a tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Create snapshot completed successfully Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "cinder-4d70e29c-b31d-453b-b7de-bb913d7d9fd7-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-4d70e29c-b31d-453b-b7de-bb913d7d9fd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:46 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 1073741824" returned: 0 in 0.565s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "cinder-quobyte-4d70e29c-b31d-453b-b7de-bb913d7d9fd7" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-4d70e29c-b31d-453b-b7de-bb913d7d9fd7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Deleting offline snapshot 4d70e29c-b31d-453b-b7de-bb913d7d9fd7 of volume cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] snapshot_file for this snap is: volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fd6e66-3bf8-4e1e-b384-3df1e98a75ea]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:46 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:24:46 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:46 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 Aug 28 16:24:46 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:46 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 0.303s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbf52f3-7fac-4b90-8b0c-dfaf533b19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ff819d-c751-4128-88ae-3b64d26d1ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Volume volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 (e72ae3d9-8db3-40ef-ae7a-c948dd989656): created successfully Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ff819d-c751-4128-88ae-3b64d26d1ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (91d0ffbe-4d14-487c-8896-15fbcffa1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b21a37cb-d346-4fd0-b53d-e17eac27efa9 tempest-VolumesSnapshotTestJSON-131510247 None] Created volume successfully. Aug 28 16:24:46 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7" returned: 0 in 0.487s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f906c0d-7f6a-4bd6-aa9f-64ba608ab7cd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:46 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b Aug 28 16:24:46 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Acquiring lock "cinder-25886b94-f7c1-4c4e-89d3-bacb3bd557cd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "cinder-25886b94-f7c1-4c4e-89d3-bacb3bd557cd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Acquiring lock "cinder-quobyte-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "cinder-quobyte-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[538bab68-f713-443c-8e92-59e674e2b1ca]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Creating offline snapshot 0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef of volume e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe3df4f-baf2-476b-9887-23698c7e0a2d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd Aug 28 16:24:47 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:24:47 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" returned: 0 in 0.522s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 Aug 28 16:24:47 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" returned: 0 in 0.402s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd Aug 28 16:24:47 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef 1G Aug 28 16:24:47 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7" returned: 0 in 0.377s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7 Aug 28 16:24:47 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" returned: 0 in 0.266s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "cinder-quobyte-25886b94-f7c1-4c4e-89d3-bacb3bd557cd" released by "delete_volume" :: held 0.720s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Created reservations ['38491ec6-9742-4013-9499-944956358514', '47bb614a-47ab-4b12-9f30-57a7942a38d4', 'f36639b1-124e-4e13-b487-edc9bd6b5bc9', '3efd7836-0fb9-4759-98d5-34f88dcf1542'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:47 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:47 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b.4d70e29c-b31d-453b-b7de-bb913d7d9fd7" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-4d70e29c-b31d-453b-b7de-bb913d7d9fd7" released by "_delete_snapshot" :: held 1.837s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" released by "delete_snapshot" :: held 1.880s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:47 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef 1G" returned: 0 in 0.536s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:48 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:24:48 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Created reservations ['1bbe8eac-da5a-4db3-b60c-ecb3dc5e1db4', 'c9da4bae-de62-48ca-954f-a0ab4700c36a', 'b40255b0-c842-433b-9165-ef5dbb4ce7a8', '1a48de76-19e9-45cd-a04a-83f91a50e351'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Delete snapshot completed successfully. Aug 28 16:24:48 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-718c0720-208b-41d5-b888-e4c671bb3455 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-4d70e29c-b31d-453b-b7de-bb913d7d9fd7-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.377s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Deleted volume successfully. Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-343bd03c-8fab-4c4f-8ddc-3131f6d91958 tempest-AttachVolumeShelveTestJSON-1100036726 None] Lock "cinder-25886b94-f7c1-4c4e-89d3-bacb3bd557cd-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "cinder-cb9b0c33-658f-422f-86be-b81a5a3d1f6b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:48 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-cb9b0c33-658f-422f-86be-b81a5a3d1f6b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.516s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:48 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef is being set with open permissions: ugo+rw Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:48 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:24:48 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4cee2b-1ea2-4b78-9235-cb361c98e3a3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:48 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.286s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:48 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b Aug 28 16:24:48 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:48 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info Aug 28 16:24:48 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:49 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:49 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:49 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info is being set with open permissions: ugo+rw Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:49 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b Aug 28 16:24:49 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:49 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info Aug 28 16:24:49 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:49 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.info" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:49 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-quobyte-cb9b0c33-658f-422f-86be-b81a5a3d1f6b" released by "delete_volume" :: held 0.887s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8f8ab910-a90b-4b33-b664-d083afe3697a tempest-VolumesSnapshotTestJSON-131510247 None] Create snapshot completed successfully Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Created reservations ['3939978c-a08b-4ad9-a20d-207cac194904', 'f89a379a-9d15-4200-88b9-66b19b2961e8', '3720ed15-715e-41ca-9094-6ff07098596f', '96a63cd8-9e63-4692-815a-678c3aaa1b71'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:49 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:24:49 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:49 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.259s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:24:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Deleted volume successfully. Aug 28 16:24:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-46b3574f-b3ba-4bf3-9a5f-8d36b8fced31 tempest-VolumesSnapshotNegativeTestJSON-96363532 None] Lock "cinder-cb9b0c33-658f-422f-86be-b81a5a3d1f6b-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (30ebe925-0a74-4577-a85e-206acd2a5fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a9fe43-5c4c-4c60-bc61-bbc24106b5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a9fe43-5c4c-4c60-bc61-bbc24106b5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-985268667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be878f7c-fb2f-4863-b9ca-251e7122d409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b2c9a0d2b54226bf31ad5ab03a16c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:51Z,use_quota=True,user_id='77758216edcc4223bcbe692ca4986953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d03d1a3-3057-46da-8f52-48c1dacb086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d03d1a3-3057-46da-8f52-48c1dacb086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31beeefe-c723-4bcd-b11f-7dfd4cd63af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31beeefe-c723-4bcd-b11f-7dfd4cd63af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be878f7c-fb2f-4863-b9ca-251e7122d409', 'volume_name': 'volume-be878f7c-fb2f-4863-b9ca-251e7122d409', 'volume_size': 1, 'snapshot_id': '0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3229841-64a5-4f0e-b22a-646b81c8a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3229841-64a5-4f0e-b22a-646b81c8a708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9035a276-8a22-4568-b7b1-9cf27d3b927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:50 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Volume be878f7c-fb2f-4863-b9ca-251e7122d409: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be878f7c-fb2f-4863-b9ca-251e7122d409', 'volume_size': 1, 'snapshot_id': '0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef'} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-be878f7c-fb2f-4863-b9ca-251e7122d409" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-be878f7c-fb2f-4863-b9ca-251e7122d409" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Creating volume be878f7c-fb2f-4863-b9ca-251e7122d409 from snapshot 0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] snapshot: 0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef, volume: be878f7c-fb2f-4863-b9ca-251e7122d409, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1846fd-baa3-4e3a-abf5-45ee673f20b3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:51 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:24:51 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:51 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e916ea-bdd3-4759-9b6a-53185d33a855]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:51 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:24:51 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:51 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 0.378s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:24:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:51 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 Aug 28 16:24:51 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (c39c78dc-b677-4799-95e1-91666ef7df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23220b9f-0282-48ea-9080-9264738fc146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23220b9f-0282-48ea-9080-9264738fc146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2065182434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2d8e66-c80e-4e4a-afc0-070fbac86c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:56Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f01213-50d5-428d-a7d6-f014c982ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f01213-50d5-428d-a7d6-f014c982ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f58d1d-3dca-4fe2-a6da-1bd0f148cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f58d1d-3dca-4fe2-a6da-1bd0f148cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2d8e66-c80e-4e4a-afc0-070fbac86c16', 'volume_name': 'volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03df94f-908a-434d-9f65-e8c8a8e9e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03df94f-908a-434d-9f65-e8c8a8e9e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ce0af-7613-46ad-bcb7-9a74f1623291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:56 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Volume 0e2d8e66-c80e-4e4a-afc0-070fbac86c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16', 'volume_size': 1} Aug 28 16:24:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:58 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409" returned: 0 in 6.161s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:24:58 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Converted 1024.00 MB image at 166.18 MB/s Aug 28 16:24:58 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 is being set with open permissions: ugo+rw Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:58 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 Aug 28 16:24:58 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:58 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" released by "_copy_volume_from_snapshot" :: held 7.402s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-be878f7c-fb2f-4863-b9ca-251e7122d409" released by "_create_volume_from_snapshot" :: held 7.486s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.508s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2065182434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2d8e66-c80e-4e4a-afc0-070fbac86c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:24:56Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Creating volume 0e2d8e66-c80e-4e4a-afc0-070fbac86c16 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:24:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:58 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 1073741824 Aug 28 16:24:58 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9035a276-8a22-4568-b7b1-9cf27d3b927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be878f7c-fb2f-4863-b9ca-251e7122d409', 'volume_size': 1, 'snapshot_id': '0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146af762-7c76-4c5c-801c-d6086a73107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Volume volume-be878f7c-fb2f-4863-b9ca-251e7122d409 (be878f7c-fb2f-4863-b9ca-251e7122d409): created successfully Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146af762-7c76-4c5c-801c-d6086a73107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Flow 'volume_create_manager' (30ebe925-0a74-4577-a85e-206acd2a5fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c9acf843-ba9a-41fb-bcd0-352063c5f1bc tempest-VolumesSnapshotTestJSON-131510247 None] Created volume successfully. Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-be878f7c-fb2f-4863-b9ca-251e7122d409-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-be878f7c-fb2f-4863-b9ca-251e7122d409-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43cefc4-6c0c-4b80-8a3c-de48d01ec8c3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:59 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 1073741824" returned: 0 in 0.651s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:59 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 Aug 28 16:24:59 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:59 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 Aug 28 16:24:59 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:59 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" returned: 0 in 0.314s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7ce0af-7613-46ad-bcb7-9a74f1623291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:59 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505d62cb-4e81-4cfd-8680-b46334e370ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409" returned: 0 in 0.567s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:24:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Volume volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 (0e2d8e66-c80e-4e4a-afc0-070fbac86c16): created successfully Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505d62cb-4e81-4cfd-8680-b46334e370ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:24:59 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409 Aug 28 16:24:59 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (c39c78dc-b677-4799-95e1-91666ef7df64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:24:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0c101191-e3b4-47e5-b01d-d364ee78f266 tempest-AttachVolumeTestJSON-1175656600 None] Created volume successfully. Aug 28 16:24:59 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-be878f7c-fb2f-4863-b9ca-251e7122d409" returned: 0 in 0.304s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-be878f7c-fb2f-4863-b9ca-251e7122d409" released by "delete_volume" :: held 0.929s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:24:59 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['6a1bf661-7d73-4422-9e4d-d2c05c2ebd48', '4bf61e9b-6e1c-46a4-9fab-2d965f23903f', 'cc164778-ff23-4bda-a631-186a6852adf7', 'b5de67c6-78e3-40b2-af9f-699bd4851099'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:00 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:00 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Deleting offline snapshot 0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef of volume e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] snapshot_file for this snap is: volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[95438a65-4a6d-4328-92d3-3358ef010496]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:00 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.312s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Deleted volume successfully. Aug 28 16:25:00 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:25:00 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-56930f5c-58e6-4644-9508-75b65ce851eb tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-be878f7c-fb2f-4863-b9ca-251e7122d409-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:00 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.452s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae98af-fc36-421f-ae5e-027e9b32ea39]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:00 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:25:00 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (d2e517e4-a6f8-4568-87ba-78df40d26849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52ca925-d345-47a5-9137-297f8cf170e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52ca925-d345-47a5-9137-297f8cf170e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-613016587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c171435-b898-47aa-9846-f6607702e52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:01Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd214f5-6d5e-475f-9894-b8df4ffdcff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd214f5-6d5e-475f-9894-b8df4ffdcff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c6da43-f25e-4ac7-98e4-0d1c2a15badd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:01 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c6da43-f25e-4ac7-98e4-0d1c2a15badd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c171435-b898-47aa-9846-f6607702e52f', 'volume_name': 'volume-5c171435-b898-47aa-9846-f6607702e52f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048980fa-1bbb-44fa-9a4e-9a644025c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048980fa-1bbb-44fa-9a4e-9a644025c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f47d580-cb0a-4598-80da-2633640a58b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Volume 5c171435-b898-47aa-9846-f6607702e52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c171435-b898-47aa-9846-f6607702e52f', 'volume_size': 1} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-613016587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c171435-b898-47aa-9846-f6607702e52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:01Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Creating volume 5c171435-b898-47aa-9846-f6607702e52f {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 1.050s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:01 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f 1073741824 Aug 28 16:25:01 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:01 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:25:01 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-5200e5f8-ba4b-4203-a2d5-c6fb74f9c792 req-b762d596-0258-466d-95b5-07f080fc908c tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:02 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.593s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:02 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef Aug 28 16:25:02 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:02 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f 1073741824" returned: 0 in 0.693s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:02 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f Aug 28 16:25:02 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:02 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656.0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" returned: 0 in 0.284s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef" released by "_delete_snapshot" :: held 2.525s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" released by "delete_snapshot" :: held 2.556s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:02 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f" returned: 0 in 0.277s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-5200e5f8-ba4b-4203-a2d5-c6fb74f9c792 req-b762d596-0258-466d-95b5-07f080fc908c tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.711s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f47d580-cb0a-4598-80da-2633640a58b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c171435-b898-47aa-9846-f6607702e52f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a163aa12-9dc8-4bad-913e-0b8b4b6b44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['e97056de-17f9-4d42-b5e6-6b3d1b718419', '27b64c1d-1257-405c-94a5-73902b615824', 'e1737a59-9bcb-4c6a-abc6-16757838cb79', '39403770-e936-4147-ad8a-eda11d8783c1'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-5200e5f8-ba4b-4203-a2d5-c6fb74f9c792 req-b762d596-0258-466d-95b5-07f080fc908c tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.112s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Volume volume-5c171435-b898-47aa-9846-f6607702e52f (5c171435-b898-47aa-9846-f6607702e52f): created successfully Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a163aa12-9dc8-4bad-913e-0b8b4b6b44a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (d2e517e4-a6f8-4568-87ba-78df40d26849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d6316f19-66d9-4d1e-81b4-29ec199cefe2 tempest-VolumesTestJSON-1825128915 None] Created volume successfully. Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-5200e5f8-ba4b-4203-a2d5-c6fb74f9c792 req-b762d596-0258-466d-95b5-07f080fc908c tempest-AttachVolumeTestJSON-1175656600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3b566a6-7df5-4d44-b757-ebfb67d75db8', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:25:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Delete snapshot completed successfully. Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e38ae579-ea6b-4021-a37f-0e84e469e6ee tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-0c96c1a8-d5a3-48c2-9c6e-7588fd27e9ef-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-5200e5f8-ba4b-4203-a2d5-c6fb74f9c792 req-b762d596-0258-466d-95b5-07f080fc908c tempest-AttachVolumeTestJSON-1175656600 None] attachment_update completed successfully. Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-e72ae3d9-8db3-40ef-ae7a-c948dd989656-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-e72ae3d9-8db3-40ef-ae7a-c948dd989656-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539dbc7-6b2e-4461-925a-750510b9818a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:04 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:25:04 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:04 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 0.598s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (06aa1bb0-e679-4284-a398-868e40f52e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5c1065-59fb-4dfb-87e5-c56b15e45591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:04 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656 Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5c1065-59fb-4dfb-87e5-c56b15e45591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ea0ee-852c-4a9b-acb0-0c1010701b18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:04Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:04 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b95d777-1214-463c-a9a6-714899fb1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b95d777-1214-463c-a9a6-714899fb1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f089660-8867-471e-97ef-95bcc9ace1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f089660-8867-471e-97ef-95bcc9ace1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3ea0ee-852c-4a9b-acb0-0c1010701b18', 'volume_name': 'volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2ed083-7183-4665-8f3a-e5aeab332108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2ed083-7183-4665-8f3a-e5aeab332108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6e62ed-b293-43b2-9980-c6d7cf50fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Volume ad3ea0ee-852c-4a9b-acb0-0c1010701b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18', 'volume_size': 1} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ea0ee-852c-4a9b-acb0-0c1010701b18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:04Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Creating volume ad3ea0ee-852c-4a9b-acb0-0c1010701b18 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:04 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:04 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 1073741824 Aug 28 16:25:04 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:04 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e72ae3d9-8db3-40ef-ae7a-c948dd989656" returned: 0 in 0.390s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-e72ae3d9-8db3-40ef-ae7a-c948dd989656" released by "delete_volume" :: held 1.170s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['25b554b7-398e-49e9-ac4e-df6fd3340672', '87b1da51-e570-40cf-beeb-ff2c16871b15', 'cea6ff39-d30b-4ed2-ac03-06317ed674dd', 'abefb09a-ffc0-4bf0-ac02-df8945395379'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:05 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:05 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:05 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 1073741824" returned: 0 in 0.735s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:05 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 Aug 28 16:25:05 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:05 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.628s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:05 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Deleted volume successfully. Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" returned: 0 in 0.475s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93c161b4-a9a5-418c-a479-4744ccd89ff4 tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-e72ae3d9-8db3-40ef-ae7a-c948dd989656-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6e62ed-b293-43b2-9980-c6d7cf50fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9481440c-14d8-4697-b371-c0779185cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Volume volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 (ad3ea0ee-852c-4a9b-acb0-0c1010701b18): created successfully Aug 28 16:25:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9481440c-14d8-4697-b371-c0779185cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (06aa1bb0-e679-4284-a398-868e40f52e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1031586f-8576-42f3-b1f0-24b337fefc1d tempest-VolumesTestJSON-1825128915 None] Created volume successfully. Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (22e6caf9-2ba3-4841-88dc-d8c5da71ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a483a-069e-4e28-8f67-b0c4047787ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-1a99693c-ade0-4982-9224-e907a332df95-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a483a-069e-4e28-8f67-b0c4047787ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-49621409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb116b3-f3eb-4901-b872-8bca21b3b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:06Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eb578e-9a3b-4aaf-bb58-144c55a08abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eb578e-9a3b-4aaf-bb58-144c55a08abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d9abeb-80b3-4716-b220-33daccfd4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d9abeb-80b3-4716-b220-33daccfd4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb116b3-f3eb-4901-b872-8bca21b3b681', 'volume_name': 'volume-6fb116b3-f3eb-4901-b872-8bca21b3b681', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7098a96b-b44e-455d-b29d-f4ee4a9a7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7098a96b-b44e-455d-b29d-f4ee4a9a7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07f63b8-583a-4da7-b4ea-e5789ef7bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Volume 6fb116b3-f3eb-4901-b872-8bca21b3b681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb116b3-f3eb-4901-b872-8bca21b3b681', 'volume_size': 1} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-49621409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb116b3-f3eb-4901-b872-8bca21b3b681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f17e79a8254971ba0c1e466231cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:06Z,use_quota=True,user_id='fd8edc29d83642b5a77de28a8fe0b013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Creating volume 6fb116b3-f3eb-4901-b872-8bca21b3b681 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:06 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-1a99693c-ade0-4982-9224-e907a332df95-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:06 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 1073741824 Aug 28 16:25:06 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[674179de-c947-4fce-925a-4b9b48007800]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:06 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 Aug 28 16:25:06 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:06 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 1073741824" returned: 0 in 0.671s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:07 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95" returned: 0 in 0.586s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:07 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 Aug 28 16:25:07 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95 Aug 28 16:25:07 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:07 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:07 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1a99693c-ade0-4982-9224-e907a332df95" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-quobyte-1a99693c-ade0-4982-9224-e907a332df95" released by "delete_volume" :: held 1.068s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:07 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681" returned: 0 in 0.469s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07f63b8-583a-4da7-b4ea-e5789ef7bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb116b3-f3eb-4901-b872-8bca21b3b681', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a91b50d-caf3-4d5d-9a99-d44d03d53658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (f57253b4-8dc7-4456-b46f-970c1c437f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b1db88-0500-4eb7-b429-c997c932cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Volume volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 (6fb116b3-f3eb-4901-b872-8bca21b3b681): created successfully Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a91b50d-caf3-4d5d-9a99-d44d03d53658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Flow 'volume_create_manager' (22e6caf9-2ba3-4841-88dc-d8c5da71ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b1db88-0500-4eb7-b429-c997c932cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1886145510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b28dca2-afdb-4e05-983a-59170b21c314,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:07Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d939bbec-67b9-4b8f-a540-3e11fb1f4240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d939bbec-67b9-4b8f-a540-3e11fb1f4240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2054f58-8cb9-4f06-a5ea-4311b24b481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2054f58-8cb9-4f06-a5ea-4311b24b481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b28dca2-afdb-4e05-983a-59170b21c314', 'volume_name': 'volume-7b28dca2-afdb-4e05-983a-59170b21c314', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8fbab-e036-4eec-bf8b-954d5d0e077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8fbab-e036-4eec-bf8b-954d5d0e077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b5e6c-e8ab-4dbe-90af-2f63be53b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Volume 7b28dca2-afdb-4e05-983a-59170b21c314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b28dca2-afdb-4e05-983a-59170b21c314', 'volume_size': 1} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1886145510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b28dca2-afdb-4e05-983a-59170b21c314,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='731a7213a71046b99b49c98053465561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:07Z,use_quota=True,user_id='637a969465fc48079bf836e0c78b4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Creating volume 7b28dca2-afdb-4e05-983a-59170b21c314 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:07 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Created reservations ['cf6aeeeb-d615-42f7-86f9-39ab0f041aba', '302631b6-2b11-4899-b998-466836c4e151', '9de79702-193e-4acc-9c39-fad1440ac8f2', '1669d918-b401-4bfb-8547-1d91173e51ba'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:07 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 1073741824 Aug 28 16:25:07 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3f01d8f9-7b6b-441e-8833-92c8e507a719 tempest-AttachVolumeTestJSON-1175656600 None] Created volume successfully. Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:07 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:07 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:08 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.312s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Deleted volume successfully. Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f9012f07-49ff-4850-a4b3-7dbf3da74c8a tempest-VolumesSnapshotTestJSON-131510247 None] Lock "cinder-1a99693c-ade0-4982-9224-e907a332df95-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:08 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 1073741824" returned: 0 in 0.598s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:08 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 Aug 28 16:25:08 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:08 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314" returned: 0 in 0.489s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427b5e6c-e8ab-4dbe-90af-2f63be53b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b28dca2-afdb-4e05-983a-59170b21c314', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a50c467-fa90-45fa-ba28-de9dde0a8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Volume volume-7b28dca2-afdb-4e05-983a-59170b21c314 (7b28dca2-afdb-4e05-983a-59170b21c314): created successfully Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a50c467-fa90-45fa-ba28-de9dde0a8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Flow 'volume_create_manager' (f57253b4-8dc7-4456-b46f-970c1c437f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9349f1bd-2ae3-42f4-8083-a05df359fe3b tempest-VolumesTestJSON-1825128915 None] Created volume successfully. Aug 28 16:25:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-3b55cff7-5487-4941-847a-1c51023ebf68 req-c22cc68e-2a1c-4ad4-891c-3ce1e8974013 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-3b55cff7-5487-4941-847a-1c51023ebf68 req-c22cc68e-2a1c-4ad4-891c-3ce1e8974013 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-3b55cff7-5487-4941-847a-1c51023ebf68 req-c22cc68e-2a1c-4ad4-891c-3ce1e8974013 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-3b55cff7-5487-4941-847a-1c51023ebf68 req-c22cc68e-2a1c-4ad4-891c-3ce1e8974013 tempest-AttachVolumeTestJSON-1175656600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-6fb116b3-f3eb-4901-b872-8bca21b3b681', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1198ca27-fdd3-469e-9dcc-e3d0ba5e4cf9', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:25:09 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-3b55cff7-5487-4941-847a-1c51023ebf68 req-c22cc68e-2a1c-4ad4-891c-3ce1e8974013 tempest-AttachVolumeTestJSON-1175656600 None] attachment_update completed successfully. Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-7b28dca2-afdb-4e05-983a-59170b21c314-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "cinder-7b28dca2-afdb-4e05-983a-59170b21c314-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-quobyte-7b28dca2-afdb-4e05-983a-59170b21c314" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-7b28dca2-afdb-4e05-983a-59170b21c314" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86be06-56e4-4145-9cf4-2665374879ce]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:10 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 Aug 28 16:25:10 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:11 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314" returned: 0 in 0.488s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:11 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314 Aug 28 16:25:11 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:11 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7b28dca2-afdb-4e05-983a-59170b21c314" returned: 0 in 0.309s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-7b28dca2-afdb-4e05-983a-59170b21c314" released by "delete_volume" :: held 0.863s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Created reservations ['bc07defa-075e-40c3-b43f-b56a227d4f0e', '43ab8e28-0120-42f1-b64b-6cb425de3176', '74a1f5fe-96f0-4ad7-9112-bcdcc1615896', '8843617f-9087-4ead-a5fe-620a2d3bfb77'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:11 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:11 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-ad3ea0ee-852c-4a9b-acb0-0c1010701b18-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "cinder-ad3ea0ee-852c-4a9b-acb0-0c1010701b18-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-quobyte-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2588e1-8c68-439b-aa9c-97319eb3a01f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-19dd9ebb-820a-4086-a61c-00cd8080c111 req-0626297c-67ae-45ce-89f0-3727d67f89a0 tempest-AttachVolumeTestJSON-1175656600 None] Terminate volume connection completed successfully. Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-19dd9ebb-820a-4086-a61c-00cd8080c111 req-0626297c-67ae-45ce-89f0-3727d67f89a0 tempest-AttachVolumeTestJSON-1175656600 None] Deleting attachment f3b566a6-7df5-4d44-b757-ebfb67d75db8. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:25:12 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.491s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:12 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 Aug 28 16:25:12 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Deleted volume successfully. Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f64a4dce-c32e-4f5b-84ae-f5c34605b79b tempest-VolumesTestJSON-1825128915 None] Lock "cinder-7b28dca2-afdb-4e05-983a-59170b21c314-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:12 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" returned: 0 in 0.513s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:12 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18 Aug 28 16:25:12 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:13 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" returned: 0 in 0.311s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-ad3ea0ee-852c-4a9b-acb0-0c1010701b18" released by "delete_volume" :: held 0.885s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Created reservations ['f21d320d-135b-45d3-b141-5c754a0060f1', 'bbf6e377-d779-405f-b0a1-88aad463311f', 'be96d75e-8a5e-4e4d-8274-2d2a325a82fe', '25853444-8f87-4b35-b554-f62e36cff59a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:13 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:13 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:13 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Deleted volume successfully. Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6c3e5297-a4a5-4fe9-856e-5c37b2d1031f tempest-VolumesTestJSON-1825128915 None] Lock "cinder-ad3ea0ee-852c-4a9b-acb0-0c1010701b18-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-1f979c08-507b-46a1-84bf-74b862691444 req-7d51a9ab-5dbc-4ab2-9d99-295200f363ea tempest-AttachVolumeTestJSON-1175656600 None] Terminate volume connection completed successfully. Aug 28 16:25:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-1f979c08-507b-46a1-84bf-74b862691444 req-7d51a9ab-5dbc-4ab2-9d99-295200f363ea tempest-AttachVolumeTestJSON-1175656600 None] Deleting attachment 1198ca27-fdd3-469e-9dcc-e3d0ba5e4cf9. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-5c171435-b898-47aa-9846-f6607702e52f-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "cinder-5c171435-b898-47aa-9846-f6607702e52f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Acquiring lock "cinder-quobyte-5c171435-b898-47aa-9846-f6607702e52f" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-5c171435-b898-47aa-9846-f6607702e52f" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b815beb-2299-4a67-bd66-a393c9c3e021]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:14 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f Aug 28 16:25:14 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:14 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f" returned: 0 in 0.545s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:15 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f Aug 28 16:25:15 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:15 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c171435-b898-47aa-9846-f6607702e52f" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "cinder-quobyte-5c171435-b898-47aa-9846-f6607702e52f" released by "delete_volume" :: held 1.097s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Created reservations ['c1ae34d3-5c48-44ab-a617-d2ef190867db', 'b28e8a0f-dbe2-4d70-87a2-03bf1bc7cb0d', '85ea8b3e-9b3b-4cbb-91d8-35216443eac0', '1ec1a4c6-6dab-46a9-8afb-acca33405c79'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:15 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:15 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:16 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:16 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Deleted volume successfully. Aug 28 16:25:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5c45a609-4e02-4c9f-ace5-b38dadca794c tempest-VolumesTestJSON-1825128915 None] Lock "cinder-5c171435-b898-47aa-9846-f6607702e52f-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:25 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=98,cinder:INSERT=28,cinder:UPDATE=133,cinder:DELETE=9 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=94,cinder:UPDATE=95,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-6fb116b3-f3eb-4901-b872-8bca21b3b681-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-6fb116b3-f3eb-4901-b872-8bca21b3b681-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-quobyte-6fb116b3-f3eb-4901-b872-8bca21b3b681" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-6fb116b3-f3eb-4901-b872-8bca21b3b681" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1bb6f-8bdb-40f4-96ca-1f4a04a27498]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:26 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 Aug 28 16:25:26 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:26 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681" returned: 0 in 0.442s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:26 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681 Aug 28 16:25:26 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:27 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6fb116b3-f3eb-4901-b872-8bca21b3b681" returned: 0 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-6fb116b3-f3eb-4901-b872-8bca21b3b681" released by "delete_volume" :: held 0.868s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Created reservations ['2b615c41-c6d9-4938-b392-ea06be9ea6a1', '345954be-6c9c-465e-81ff-49152ca904b9', '76c397f0-5e3b-414b-b4dd-4ac9517bd790', 'e43dfa06-d828-474b-8350-3c7fa3b495a1'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:27 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:27 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-0e2d8e66-c80e-4e4a-afc0-070fbac86c16-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-0e2d8e66-c80e-4e4a-afc0-070fbac86c16-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-quobyte-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fe8e0d-6ecb-4aa9-84cb-af2b4aaf294c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:27 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.385s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Deleted volume successfully. Aug 28 16:25:27 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 Aug 28 16:25:27 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-155d140d-55ce-4555-85fa-abaa938682c9 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-6fb116b3-f3eb-4901-b872-8bca21b3b681-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:28 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" returned: 0 in 0.495s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:28 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16 Aug 28 16:25:28 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:28 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-0e2d8e66-c80e-4e4a-afc0-070fbac86c16" released by "delete_volume" :: held 1.027s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Created reservations ['5a23bff0-5da1-4b9b-bf56-70c901301f69', 'e49bfc83-4182-470c-94de-f9608c0eeb25', '180da4cc-36d6-475a-93bb-d3728349b6fa', '54678181-bd09-4b96-9836-4e5022340266'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:29 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:29 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:29 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.402s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:29 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Deleted volume successfully. Aug 28 16:25:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ffe611-8602-4b8e-81c1-35a521665125 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-0e2d8e66-c80e-4e4a-afc0-070fbac86c16-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a55ccd12-f5a8-4427-a847-7da6ad4e40b5 tempest-GroupsV314Test-386483194 None] Group tempest-GroupsV314Test-Group-1988405924: creating Aug 28 16:25:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a55ccd12-f5a8-4427-a847-7da6ad4e40b5 tempest-GroupsV314Test-386483194 None] Group tempest-GroupsV314Test-Group-1988405924: created successfully Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-0e929fae-0a36-4781-8b20-545318ab916b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a55ccd12-f5a8-4427-a847-7da6ad4e40b5 tempest-GroupsV314Test-386483194 None] Create group completed successfully. Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-0e929fae-0a36-4781-8b20-545318ab916b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "cinder-quobyte-0e929fae-0a36-4781-8b20-545318ab916b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-0e929fae-0a36-4781-8b20-545318ab916b" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e98334-9790-4a06-a517-b5ace2dcf495]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:30 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b Aug 28 16:25:30 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:30 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b" returned: 0 in 0.459s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:30 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b Aug 28 16:25:30 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:31 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0e929fae-0a36-4781-8b20-545318ab916b" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-quobyte-0e929fae-0a36-4781-8b20-545318ab916b" released by "delete_volume" :: held 0.907s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Created reservations ['ff4764d0-891c-4d5d-b6fb-9deb2adba464', '012e688e-6d77-478d-8754-401eeebe4d8b', '87af05db-1188-43d6-af25-2a6cfcc884a2', '6f2e2455-eaac-4746-b367-2478d8769bb6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:31 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:31 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:31 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:31 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:32 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.582s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Flow 'volume_create_manager' (0feaf0b4-439f-46e0-8c52-cef4e62c7cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea14c3d-977d-43e6-9586-5c5d00065c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:32 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea14c3d-977d-43e6-9586-5c5d00065c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902929842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15eb8efd-4ec8-477a-a1ef-160cb1e4472b,host='devstack@QuobyteHD#QuobyteHD',id=4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf1e8cbeec44e2a94517b6422d67f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:32Z,use_quota=True,user_id='d97d5d9a90a74ca3aa1965423f2c84c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(715f0cbe-486a-4066-9ec0-45a422f50e9b),volume_type_id=715f0cbe-486a-4066-9ec0-45a422f50e9b)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875899b1-f77f-40d9-9d39-a2ba41d568c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875899b1-f77f-40d9-9d39-a2ba41d568c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6aca1-6c2d-4585-8268-ddf686469569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b6aca1-6c2d-4585-8268-ddf686469569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca', 'volume_name': 'volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b79df-d1ac-4ff4-8464-fafff7753027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b79df-d1ac-4ff4-8464-fafff7753027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5182f24-e7b9-4bd8-9fd7-687d21018003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:32 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Volume 4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca', 'volume_size': 1} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15eb8efd-4ec8-477a-a1ef-160cb1e4472b,created_at=2026-08-28T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902929842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15eb8efd-4ec8-477a-a1ef-160cb1e4472b,host='devstack@QuobyteHD#QuobyteHD',id=4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf1e8cbeec44e2a94517b6422d67f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:32Z,use_quota=True,user_id='d97d5d9a90a74ca3aa1965423f2c84c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(715f0cbe-486a-4066-9ec0-45a422f50e9b),volume_type_id=715f0cbe-486a-4066-9ec0-45a422f50e9b)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Creating volume 4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:32 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.890s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Deleted volume successfully. Aug 28 16:25:32 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca 1073741824 Aug 28 16:25:32 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a0bf734f-f6e0-4ffa-85f1-852a05fec8c7 tempest-AttachVolumeTestJSON-1175656600 None] Lock "cinder-0e929fae-0a36-4781-8b20-545318ab916b-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:33 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca 1073741824" returned: 0 in 0.918s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:33 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:33 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:33 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.391s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5182f24-e7b9-4bd8-9fd7-687d21018003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5effe125-3c20-4a83-9fbe-09cb28b70794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:34 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Volume volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca (4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca): created successfully Aug 28 16:25:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5effe125-3c20-4a83-9fbe-09cb28b70794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Flow 'volume_create_manager' (0feaf0b4-439f-46e0-8c52-cef4e62c7cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-35f4ebd0-26d8-4072-8559-0d12c9acebf9 tempest-GroupsV314Test-386483194 None] Created volume successfully. Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:36 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Cloning volume 4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca to volume 384f2076-4b51-4087-bbda-e53060d7ec2f Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Creating offline snapshot 4baf36c0-067f-4ed2-b99e-b7e908317b4e of volume 4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa20e9e3-b619-423b-afb3-de845b360cb6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:36 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:36 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:36 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.521s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:36 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e 1G Aug 28 16:25:36 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:37 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e 1G" returned: 0 in 0.599s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:37 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:37 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:37 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.417s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:37 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:25:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:37 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:37 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:37 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.310s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:38 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info Aug 28 16:25:38 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:38 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info" returned: 0 in 0.342s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:38 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:38 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info Aug 28 16:25:38 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:38 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.info" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Acquiring lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] snapshot: 4baf36c0-067f-4ed2-b99e-b7e908317b4e, volume: 384f2076-4b51-4087-bbda-e53060d7ec2f, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d07bc1f-eb69-4436-9dd5-88a58e54e380]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:38 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:38 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:39 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.435s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0101f42b-ef7e-4dfe-8080-904c7e5cb164]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:39 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:39 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:39 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.408s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:25:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:39 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f Aug 28 16:25:39 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:45 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f" returned: 0 in 5.414s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:25:45 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Converted 1024.00 MB image at 189.09 MB/s Aug 28 16:25:45 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f is being set with open permissions: ugo+rw: NotImplementedError Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:45 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f Aug 28 16:25:45 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:45 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f" returned: 0 in 0.378s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" released by "_copy_volume_from_snapshot" :: held 6.732s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Acquiring lock "cinder-quobyte-4baf36c0-067f-4ed2-b99e-b7e908317b4e" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-4baf36c0-067f-4ed2-b99e-b7e908317b4e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Deleting offline snapshot 4baf36c0-067f-4ed2-b99e-b7e908317b4e of volume 4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] snapshot_file for this snap is: volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1edd27a-a025-43f5-92c8-e03ca3596df5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:45 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:45 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:46 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.506s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:25:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c7fa64-54e8-4c92-9b0a-fd28549e7506]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:46 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:46 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.808s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:46 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:47 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:47 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:47 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.707s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:47 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e Aug 28 16:25:47 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:48 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:25:48 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca.4baf36c0-067f-4ed2-b99e-b7e908317b4e" returned: 0 in 0.494s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-4baf36c0-067f-4ed2-b99e-b7e908317b4e" released by "_delete_snapshot" :: held 2.695s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.267s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-90112f66-4a0f-40b3-a1ae-a96121f72524 tempest-GroupsV314Test-386483194 None] Create group from source-group-15eb8efd-4ec8-477a-a1ef-160cb1e4472b completed successfully. Aug 28 16:25:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Acquiring lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e346207-b599-4c22-bf41-9c1b91cc41d6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:51 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f Aug 28 16:25:51 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:51 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f" returned: 0 in 0.874s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:51 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f Aug 28 16:25:51 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:52 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-384f2076-4b51-4087-bbda-e53060d7ec2f" returned: 0 in 0.513s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-384f2076-4b51-4087-bbda-e53060d7ec2f" released by "delete_volume" :: held 1.485s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Created reservations ['5471a6c6-865e-4eb0-8733-0eb2871ef04a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:52 devstack cinder-volume[86193]: WARNING cinder.quota [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-44642614 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-44642614, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:25:52 devstack cinder-volume[86193]: WARNING cinder.quota [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-44642614 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-44642614, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Created reservations ['3011531d-54ea-44d1-aff8-74bfa59f9f82', '205694b6-bdd8-4a55-92c0-b2d1c2d03b63', '20c2a167-077d-4ec5-88cd-cc4fcfdd0e3d', '59e7d241-a7b3-415e-a31f-f5efc45506f2'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:52 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:52 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:52 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:52 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-47b148c2-c2f6-44d7-825c-48c9f7e314a2 tempest-GroupsV314Test-386483194 None] Delete group completed successfully. Aug 28 16:25:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf70cf0-ca78-42c8-87e8-3e0fdef2f7a0 tempest-BackendsCapabilitiesAdminTestsJSON-1163538059 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5247650146484, 'free_capacity_gb': 1774.5247650146484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86193) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 16:25:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cc0e41be-b264-4d1a-9cbb-19f5468c8b8d tempest-BackendsCapabilitiesAdminTestsJSON-1163538059 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5247650146484, 'free_capacity_gb': 1774.5247650146484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86193) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Acquiring lock "cinder-quobyte-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daeae5d-73de-45be-89f2-2fd11b355f09]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:54 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:54 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Flow 'volume_create_manager' (dc7b97d7-0baf-43ee-b01a-c6a1d9c2c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cdf632-b057-432f-9a2d-8fd578146849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cdf632-b057-432f-9a2d-8fd578146849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1517077989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f96b9-c978-4bcf-8957-4ebe4a676e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c731dbcce5442cafddab7924b9c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:55Z,use_quota=True,user_id='e87c99b039b54f8bae4bfe9f4b687a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82418f0b-e93b-452d-8548-764f2496cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82418f0b-e93b-452d-8548-764f2496cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8fb885-1cb9-44ef-b007-5745f1440378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8fb885-1cb9-44ef-b007-5745f1440378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33f96b9-c978-4bcf-8957-4ebe4a676e50', 'volume_name': 'volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc11e0e-7fcc-4348-bc16-150cb985103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc11e0e-7fcc-4348-bc16-150cb985103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab4624f-e62d-4e0c-84ba-065fcfbd10c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:54 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Volume d33f96b9-c978-4bcf-8957-4ebe4a676e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50', 'volume_size': 1} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1517077989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33f96b9-c978-4bcf-8957-4ebe4a676e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c731dbcce5442cafddab7924b9c3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:25:55Z,use_quota=True,user_id='e87c99b039b54f8bae4bfe9f4b687a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Creating volume d33f96b9-c978-4bcf-8957-4ebe4a676e50 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:25:54 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:54 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.822s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:54 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 1073741824 Aug 28 16:25:54 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca Aug 28 16:25:54 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:55 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:55 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" returned: 0 in 0.423s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Lock "cinder-quobyte-4c3f9b1c-ba6b-4c8d-ba3e-375a2397d3ca" released by "delete_volume" :: held 1.380s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Created reservations ['b693f971-3727-4dba-b9ae-ea731d589219'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Created reservations ['c2e0eeb1-af9c-43eb-bb72-2e7fcb9dad09', '00e3174b-1ef2-403e-be00-807b2f6dba1e', '61498276-d775-4cf4-b244-71f105ec9ced', 'b4099573-3ded-41c4-9e1d-8e8fb69036b7'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:25:55 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 1073741824" returned: 0 in 0.809s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:25:55 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 Aug 28 16:25:55 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:55 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:25:55 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:25:56 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50" returned: 0 in 0.509s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab4624f-e62d-4e0c-84ba-065fcfbd10c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bc9834-64a1-4e81-b06b-eb13ec8e1115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:25:56 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Aug 28 16:25:56 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Volume volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 (d33f96b9-c978-4bcf-8957-4ebe4a676e50): created successfully Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bc9834-64a1-4e81-b06b-eb13ec8e1115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Flow 'volume_create_manager' (dc7b97d7-0baf-43ee-b01a-c6a1d9c2c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:25:56 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:25:56 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3b0f6d01-2730-44db-92d9-fb42019938e1 tempest-GroupsV314Test-386483194 None] Delete group completed successfully. Aug 28 16:25:56 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-673a3f15-074c-407c-a267-a65a28a027fa tempest-TestMinimumBasicScenario-1610993501 None] Created volume successfully. Aug 28 16:25:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ca980bd5-8a13-4037-905c-a10ca06ea5d2 req-b9b10b0f-ad37-4966-bcc5-2a36b72d4c89 tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:25:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ca980bd5-8a13-4037-905c-a10ca06ea5d2 req-b9b10b0f-ad37-4966-bcc5-2a36b72d4c89 tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:25:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-ca980bd5-8a13-4037-905c-a10ca06ea5d2 req-b9b10b0f-ad37-4966-bcc5-2a36b72d4c89 tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:25:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-ca980bd5-8a13-4037-905c-a10ca06ea5d2 req-b9b10b0f-ad37-4966-bcc5-2a36b72d4c89 tempest-TestMinimumBasicScenario-1610993501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90b51d98-1c11-4b27-904a-74688e6fd4f2', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:25:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-ca980bd5-8a13-4037-905c-a10ca06ea5d2 req-b9b10b0f-ad37-4966-bcc5-2a36b72d4c89 tempest-TestMinimumBasicScenario-1610993501 None] attachment_update completed successfully. Aug 28 16:26:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6df90af7-e9eb-4c8b-ac19-81bb51bee36c tempest-GroupsTest-1625215923 None] Group tempest-Group1-1124016576: creating Aug 28 16:26:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6df90af7-e9eb-4c8b-ac19-81bb51bee36c tempest-GroupsTest-1625215923 None] Group tempest-Group1-1124016576: created successfully Aug 28 16:26:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6df90af7-e9eb-4c8b-ac19-81bb51bee36c tempest-GroupsTest-1625215923 None] Create group completed successfully. Aug 28 16:26:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cc616249-701e-4de1-9995-f0be4426a701 tempest-GroupsTest-1625215923 None] Group tempest-Group2-1468932745: creating Aug 28 16:26:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cc616249-701e-4de1-9995-f0be4426a701 tempest-GroupsTest-1625215923 None] Group tempest-Group2-1468932745: created successfully Aug 28 16:26:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cc616249-701e-4de1-9995-f0be4426a701 tempest-GroupsTest-1625215923 None] Create group completed successfully. Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (86d0f4da-1eba-4293-9a5a-56e7c6ad2d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e573d0df-829c-460c-adf6-8b217a07f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e573d0df-829c-460c-adf6-8b217a07f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259865117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49291f15-810c-40fb-a3e9-d6fdd97a81ee,host='devstack@QuobyteHD#QuobyteHD',id=f08105ba-2ae2-48ce-8c63-f865fab0d9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:08Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194a506b-4ca5-4904-aca6-c49a1c5f3a7c),volume_type_id=194a506b-4ca5-4904-aca6-c49a1c5f3a7c)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79899431-1483-479f-b3a2-65545e8fbd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79899431-1483-479f-b3a2-65545e8fbd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40290c94-233d-40c9-8cf9-c6da3b652717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40290c94-233d-40c9-8cf9-c6da3b652717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08105ba-2ae2-48ce-8c63-f865fab0d9e4', 'volume_name': 'volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940e2154-0e5b-4d77-b068-f6e52ab26de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940e2154-0e5b-4d77-b068-f6e52ab26de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f79c9b5-498a-4e3d-8a6e-6a49d12dae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Volume f08105ba-2ae2-48ce-8c63-f865fab0d9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4', 'volume_size': 1} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49291f15-810c-40fb-a3e9-d6fdd97a81ee,created_at=2026-08-28T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-259865117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49291f15-810c-40fb-a3e9-d6fdd97a81ee,host='devstack@QuobyteHD#QuobyteHD',id=f08105ba-2ae2-48ce-8c63-f865fab0d9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:08Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(194a506b-4ca5-4904-aca6-c49a1c5f3a7c),volume_type_id=194a506b-4ca5-4904-aca6-c49a1c5f3a7c)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Creating volume f08105ba-2ae2-48ce-8c63-f865fab0d9e4 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:08 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:08 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 1073741824 Aug 28 16:26:08 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:09 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 1073741824" returned: 0 in 0.991s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:09 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 Aug 28 16:26:09 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:09 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" returned: 0 in 0.650s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f79c9b5-498a-4e3d-8a6e-6a49d12dae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9324894e-0e06-4ae6-84be-6dcfe34c9072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Volume volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 (f08105ba-2ae2-48ce-8c63-f865fab0d9e4): created successfully Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9324894e-0e06-4ae6-84be-6dcfe34c9072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (86d0f4da-1eba-4293-9a5a-56e7c6ad2d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3793c4f3-84a8-4090-90b4-663f8a60f1b6 tempest-GroupsTest-1625215923 None] Created volume successfully. Aug 28 16:26:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Acquiring lock "cinder-quobyte-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" acquired by "delete_volume" :: waited 0.053s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76a1c8d-647c-4ecb-be50-dd29174ab3ac]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:13 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 Aug 28 16:26:13 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:13 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" returned: 0 in 0.800s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:13 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4 Aug 28 16:26:13 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:14 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-f08105ba-2ae2-48ce-8c63-f865fab0d9e4" released by "delete_volume" :: held 1.290s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Created reservations ['8ba45160-a2d6-4ee7-8b78-71b1611d987c'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:14 devstack cinder-volume[86193]: WARNING cinder.quota [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1663692775 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1663692775, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:14 devstack cinder-volume[86193]: WARNING cinder.quota [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1663692775 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1663692775, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Created reservations ['f52c962c-a286-4911-b2a7-19d838787193', '0adabbe8-49f7-408c-bd59-ae98762ffbab', '493815d6-f9e2-43ab-889a-7c2753a9f527', '0dfda83b-c2e2-4087-b89a-e20c62716c06'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:14 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:14 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:14 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:14 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1bcde732-f401-4cd6-bda3-ec61cd555572 tempest-GroupsTest-1625215923 None] Delete group completed successfully. Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Created reservations ['78a887ba-95af-4079-a150-3a5ea68541b6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:16 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:16 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:16 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.429s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:16 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c6a2b4f6-2430-45f9-8e28-4a0ea92195f3 tempest-GroupsTest-1625215923 None] Delete group completed successfully. Aug 28 16:26:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a5de0c5a-4051-484e-ac21-d325eccc0ecb tempest-GroupsTest-1625215923 None] Group tempest-GroupsTest-Group-1536376761: creating Aug 28 16:26:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a5de0c5a-4051-484e-ac21-d325eccc0ecb tempest-GroupsTest-1625215923 None] Group tempest-GroupsTest-Group-1536376761: created successfully Aug 28 16:26:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a5de0c5a-4051-484e-ac21-d325eccc0ecb tempest-GroupsTest-1625215923 None] Create group completed successfully. Aug 28 16:26:19 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (2c825e26-288e-4657-8d43-99845c00ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9da86c-a47b-446a-9ec0-7456e2f26fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9da86c-a47b-446a-9ec0-7456e2f26fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-297334845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,host='devstack@QuobyteHD#QuobyteHD',id=5f2e279e-c09b-4a5a-ac3f-892db2e01b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:20Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f71011-180a-4536-b53b-c0220a3938f5),volume_type_id=a8f71011-180a-4536-b53b-c0220a3938f5)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3248de0a-be2c-4bcd-96e0-dafb5cd93387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3248de0a-be2c-4bcd-96e0-dafb5cd93387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc9cc2f-7e73-4873-9ae1-0ed1306d0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc9cc2f-7e73-4873-9ae1-0ed1306d0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2e279e-c09b-4a5a-ac3f-892db2e01b69', 'volume_name': 'volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f23c3b-66ac-48c6-8734-5068d01a3b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f23c3b-66ac-48c6-8734-5068d01a3b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cece98c-1310-43fb-91af-715f01ddf6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Volume 5f2e279e-c09b-4a5a-ac3f-892db2e01b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69', 'volume_size': 1} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,created_at=2026-08-28T14:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-297334845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,host='devstack@QuobyteHD#QuobyteHD',id=5f2e279e-c09b-4a5a-ac3f-892db2e01b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:20Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f71011-180a-4536-b53b-c0220a3938f5),volume_type_id=a8f71011-180a-4536-b53b-c0220a3938f5)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Creating volume 5f2e279e-c09b-4a5a-ac3f-892db2e01b69 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:20 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:20 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 1073741824 Aug 28 16:26:20 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:20 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 1073741824" returned: 0 in 0.599s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:20 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 Aug 28 16:26:20 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:21 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" returned: 0 in 0.353s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cece98c-1310-43fb-91af-715f01ddf6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb20f019-687c-497b-8c65-4bbb0b97945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Volume volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 (5f2e279e-c09b-4a5a-ac3f-892db2e01b69): created successfully Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb20f019-687c-497b-8c65-4bbb0b97945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (2c825e26-288e-4657-8d43-99845c00ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-42001b32-749c-41e5-89f2-d3b763058aca tempest-GroupsTest-1625215923 None] Created volume successfully. Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (4ff39567-bbbe-4abe-a011-448c51862489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b37456a-c207-483c-80db-a003bed3cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b37456a-c207-483c-80db-a003bed3cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128256401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,host='devstack@QuobyteHD#QuobyteHD',id=5a571dc1-0e34-463b-9599-ba572ffe58cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:23Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f71011-180a-4536-b53b-c0220a3938f5),volume_type_id=a8f71011-180a-4536-b53b-c0220a3938f5)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c382e36-8465-492d-b5d6-e26d7f1c8d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c382e36-8465-492d-b5d6-e26d7f1c8d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6939fe-b262-4360-b49e-fb384743064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6939fe-b262-4360-b49e-fb384743064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a571dc1-0e34-463b-9599-ba572ffe58cf', 'volume_name': 'volume-5a571dc1-0e34-463b-9599-ba572ffe58cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3f2065-0f22-48fb-8dae-14f7ee8762b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3f2065-0f22-48fb-8dae-14f7ee8762b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31efd266-2b76-49a1-93fb-f925c8cb33c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Volume 5a571dc1-0e34-463b-9599-ba572ffe58cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a571dc1-0e34-463b-9599-ba572ffe58cf', 'volume_size': 1} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,created_at=2026-08-28T14:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128256401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b38c22c-bc7c-4657-a138-8dedeb2585ff,host='devstack@QuobyteHD#QuobyteHD',id=5a571dc1-0e34-463b-9599-ba572ffe58cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e206ecf9054cb1b26344dcc469fdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:23Z,use_quota=True,user_id='234c13e49f7548aa9b4dfad968b7fdd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f71011-180a-4536-b53b-c0220a3938f5),volume_type_id=a8f71011-180a-4536-b53b-c0220a3938f5)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Creating volume 5a571dc1-0e34-463b-9599-ba572ffe58cf {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:23 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:23 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf 1073741824 Aug 28 16:26:23 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:24 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf 1073741824" returned: 0 in 0.607s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:24 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf Aug 28 16:26:24 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:24 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31efd266-2b76-49a1-93fb-f925c8cb33c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a571dc1-0e34-463b-9599-ba572ffe58cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42016ab6-20fc-4640-84a6-5d7a75fb5824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Volume volume-5a571dc1-0e34-463b-9599-ba572ffe58cf (5a571dc1-0e34-463b-9599-ba572ffe58cf): created successfully Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42016ab6-20fc-4640-84a6-5d7a75fb5824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Flow 'volume_create_manager' (4ff39567-bbbe-4abe-a011-448c51862489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-687b62bb-3607-4988-91c0-f99a7b0dd405 tempest-GroupsTest-1625215923 None] Created volume successfully. Aug 28 16:26:25 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=83,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:26:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e5774c7c-19d9-4c86-970d-b528781a42c2 tempest-GroupsTest-1625215923 None] Update group completed successfully. Aug 28 16:26:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ff626b43-9178-44d2-9a07-991ab09959d1 tempest-GroupsTest-1625215923 None] Update group completed successfully. Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Flow 'volume_create_manager' (0b9c33fd-b403-4684-a821-8d837a7fcb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb442abb-77e8-40a9-a2c1-cbe542e2d7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb442abb-77e8-40a9-a2c1-cbe542e2d7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1303381078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa450741-39b2-43d3-a4e2-0b9daa99f67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03445ace63a4864820b61c0bd788517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:28Z,use_quota=True,user_id='899aff1891ff46549868470a27d0f366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6854e56-ad91-4b41-81e4-4beb2b75175c),volume_type_id=b6854e56-ad91-4b41-81e4-4beb2b75175c)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f122c04-a956-43de-a8e1-3d189d4845d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f122c04-a956-43de-a8e1-3d189d4845d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4edae4e-7d1f-4b94-9113-a0216cd94444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4edae4e-7d1f-4b94-9113-a0216cd94444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa450741-39b2-43d3-a4e2-0b9daa99f67e', 'volume_name': 'volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed7cd8b-f9ad-4e22-ac6d-de10ecfd9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed7cd8b-f9ad-4e22-ac6d-de10ecfd9c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aaf947-64af-435a-be73-82c1cfc18a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Volume fa450741-39b2-43d3-a4e2-0b9daa99f67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e', 'volume_size': 1} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1303381078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa450741-39b2-43d3-a4e2-0b9daa99f67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03445ace63a4864820b61c0bd788517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:28Z,use_quota=True,user_id='899aff1891ff46549868470a27d0f366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6854e56-ad91-4b41-81e4-4beb2b75175c),volume_type_id=b6854e56-ad91-4b41-81e4-4beb2b75175c)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Creating volume fa450741-39b2-43d3-a4e2-0b9daa99f67e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:27 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:27 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e 1073741824 Aug 28 16:26:27 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:28 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e 1073741824" returned: 0 in 0.513s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:28 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e Aug 28 16:26:28 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:28 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aaf947-64af-435a-be73-82c1cfc18a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d280f9-4e59-406c-bce0-c4bfd40c7288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Volume volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e (fa450741-39b2-43d3-a4e2-0b9daa99f67e): created successfully Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d280f9-4e59-406c-bce0-c4bfd40c7288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Flow 'volume_create_manager' (0b9c33fd-b403-4684-a821-8d837a7fcb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-664e9130-3527-487c-9e67-74f0a341c057 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Created volume successfully. Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Acquiring lock "cinder-quobyte-5a571dc1-0e34-463b-9599-ba572ffe58cf" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-5a571dc1-0e34-463b-9599-ba572ffe58cf" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91b04c1-f454-4d51-a47d-8b3e08138a88]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:29 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf Aug 28 16:26:29 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:29 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:29 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf Aug 28 16:26:29 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:29 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5a571dc1-0e34-463b-9599-ba572ffe58cf" returned: 0 in 0.275s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-5a571dc1-0e34-463b-9599-ba572ffe58cf" released by "delete_volume" :: held 0.847s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Acquiring lock "cinder-quobyte-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06d3c9d-dc28-4760-a1af-ecbb8525f6dd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:30 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 Aug 28 16:26:30 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:30 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:30 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:30 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" returned: 0 in 0.574s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:30 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69 Aug 28 16:26:30 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:30 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.401s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-27891ae5-edcd-4e07-8182-3b686df189d8 tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Retype volume completed successfully. Aug 28 16:26:30 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "cinder-quobyte-5f2e279e-c09b-4a5a-ac3f-892db2e01b69" released by "delete_volume" :: held 1.058s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Created reservations ['c9b2c752-a584-45b9-9335-9c3d9cd658ab'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:31 devstack cinder-volume[86193]: WARNING cinder.quota [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1883283487 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1883283487, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:31 devstack cinder-volume[86193]: WARNING cinder.quota [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1883283487 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1883283487, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Created reservations ['f662c52e-a25c-497e-8c0e-3d253abeafb3', '20972a0d-e783-4b28-81d2-252195a9332b', '47f8bf84-6de3-49f2-93b2-c7aeabaef64a', '140e9d51-b26f-41ca-889d-5976a01409d9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Created reservations ['98c70a86-dd28-41c5-9919-01f5d936bb57', '0d688f30-c3d8-45eb-9942-bf8154f7b756', 'dde857e9-2885-45ab-9daf-93a937fbc08b', '17beb806-5340-43a6-ab07-54dcab977ce1'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:31 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:31 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:31 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:31 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "cinder-fa450741-39b2-43d3-a4e2-0b9daa99f67e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "cinder-fa450741-39b2-43d3-a4e2-0b9daa99f67e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "cinder-quobyte-fa450741-39b2-43d3-a4e2-0b9daa99f67e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "cinder-quobyte-fa450741-39b2-43d3-a4e2-0b9daa99f67e" acquired by "delete_volume" :: waited 0.048s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:31 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.549s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090aebd-fb49-47fc-867e-cc3a01ff3591]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:32 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e Aug 28 16:26:32 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:32 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.646s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7e99b9dc-8335-4135-95e7-b5a4e249da1a tempest-GroupsTest-1625215923 None] Delete group completed successfully. Aug 28 16:26:32 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e" returned: 0 in 0.589s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:32 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e Aug 28 16:26:32 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:33 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fa450741-39b2-43d3-a4e2-0b9daa99f67e" returned: 0 in 0.454s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "cinder-quobyte-fa450741-39b2-43d3-a4e2-0b9daa99f67e" released by "delete_volume" :: held 1.171s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:33 devstack cinder-volume[86193]: WARNING cinder.quota [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:33 devstack cinder-volume[86193]: WARNING cinder.quota [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Created reservations ['56f19389-be62-44fc-9b25-522974b63212', '8070e8fd-b0fe-4a84-abcc-3ee03ae20e76', 'cf6dbfaa-740c-4f7f-b22b-59afae22a711', '41a6617e-476c-4238-8020-d4ed73e40f03'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:33 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:33 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:33 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.341s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Deleted volume successfully. Aug 28 16:26:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4e29a086-0e99-4862-8884-455fcab7b27f tempest-VolumeRetypeWithoutMigrationTest-968370494 None] Lock "cinder-fa450741-39b2-43d3-a4e2-0b9daa99f67e-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Flow 'volume_create_manager' (9845f0ab-0a0e-4c21-a6b5-5bbc45b7e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d098151-bd42-493b-9aeb-49b53e7c9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d098151-bd42-493b-9aeb-49b53e7c9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1247902071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466ae18f-3faf-44c4-938a-05f0ebd3d0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a06716a01d42dda515df1b705fef5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:38Z,use_quota=True,user_id='662d2b3b2c1b4e32a281c510dfce4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a57fd9-ac1b-4d34-8f2a-75fb695deb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a57fd9-ac1b-4d34-8f2a-75fb695deb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442de83e-3b9a-4a67-986c-1255b654e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442de83e-3b9a-4a67-986c-1255b654e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466ae18f-3faf-44c4-938a-05f0ebd3d0c2', 'volume_name': 'volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99a4dc2-a7cc-4bbf-a0d3-92ed37408206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99a4dc2-a7cc-4bbf-a0d3-92ed37408206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10342d22-9256-4c2f-aac4-fb75de295815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:38 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Volume 466ae18f-3faf-44c4-938a-05f0ebd3d0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2', 'volume_size': 1} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1247902071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466ae18f-3faf-44c4-938a-05f0ebd3d0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a06716a01d42dda515df1b705fef5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:38Z,use_quota=True,user_id='662d2b3b2c1b4e32a281c510dfce4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Creating volume 466ae18f-3faf-44c4-938a-05f0ebd3d0c2 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:38 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:38 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 1073741824 Aug 28 16:26:38 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:39 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 1073741824" returned: 0 in 0.569s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:39 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 Aug 28 16:26:39 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:39 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" returned: 0 in 0.440s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10342d22-9256-4c2f-aac4-fb75de295815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8154e1-038c-4f04-afb2-2e71592ef19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:39 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Volume volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 (466ae18f-3faf-44c4-938a-05f0ebd3d0c2): created successfully Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8154e1-038c-4f04-afb2-2e71592ef19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Flow 'volume_create_manager' (9845f0ab-0a0e-4c21-a6b5-5bbc45b7e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c2d16aea-df89-43b0-bc56-943585e0b389 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Created volume successfully. Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Flow 'volume_create_manager' (389d9328-df31-4233-a6a3-358f33dde526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f7c226-b56a-4f06-ac70-876bd62ad211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f7c226-b56a-4f06-ac70-876bd62ad211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1102923519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1647d38a-de84-4221-9217-bfefe252ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e459bca53e049199eecc6b14fae38ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:41Z,use_quota=True,user_id='de3bd4837d944d65a7d1d155b74f0893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f5c964-1c62-4c6d-adc5-3efc813517fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f5c964-1c62-4c6d-adc5-3efc813517fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da939149-3403-41ca-8ed0-87d1b5d729d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da939149-3403-41ca-8ed0-87d1b5d729d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1647d38a-de84-4221-9217-bfefe252ce3b', 'volume_name': 'volume-1647d38a-de84-4221-9217-bfefe252ce3b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fdc962-bbf5-44c0-8030-611fc09d150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fdc962-bbf5-44c0-8030-611fc09d150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f5914-ffed-43b9-b369-f3b3a19eeb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:41 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume 1647d38a-de84-4221-9217-bfefe252ce3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1647d38a-de84-4221-9217-bfefe252ce3b', 'volume_size': 1} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1102923519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1647d38a-de84-4221-9217-bfefe252ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e459bca53e049199eecc6b14fae38ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:41Z,use_quota=True,user_id='de3bd4837d944d65a7d1d155b74f0893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Creating volume 1647d38a-de84-4221-9217-bfefe252ce3b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:41 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:41 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b 1073741824 Aug 28 16:26:41 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a7f6e967-3810-4204-aeef-cfbd3af73445 req-5aa0c0e0-6146-4366-913b-eebc84216b57 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Flow 'volume_create_manager' (9f0c9aa1-7c8c-44a2-9bd4-0694c895016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60f7664-a42d-448e-bab2-23664762eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60f7664-a42d-448e-bab2-23664762eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-692359135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817b22ed-b53b-4a3f-968b-3abd8977f361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd20875ddca42a6b62937072f2722a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:42Z,use_quota=True,user_id='780ae39b91f8412e827dc05ce5d59bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a46bdd-f41c-4e72-a918-aa354badd894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a46bdd-f41c-4e72-a918-aa354badd894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292040d-0ec0-4009-9794-e95885a7362e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292040d-0ec0-4009-9794-e95885a7362e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817b22ed-b53b-4a3f-968b-3abd8977f361', 'volume_name': 'volume-817b22ed-b53b-4a3f-968b-3abd8977f361', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bf311d-ef9b-4233-88d8-ee0930cc2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bf311d-ef9b-4233-88d8-ee0930cc2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c66e55-5c64-495f-99e8-c56bdced75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Volume 817b22ed-b53b-4a3f-968b-3abd8977f361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817b22ed-b53b-4a3f-968b-3abd8977f361', 'volume_size': 1} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:42 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b 1073741824" returned: 0 in 0.593s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:42 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b Aug 28 16:26:42 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:42 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a7f6e967-3810-4204-aeef-cfbd3af73445 req-5aa0c0e0-6146-4366-913b-eebc84216b57 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.566s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f5914-ffed-43b9-b369-f3b3a19eeb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1647d38a-de84-4221-9217-bfefe252ce3b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ada331-d4ff-4469-9c22-c0804b4ab654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a7f6e967-3810-4204-aeef-cfbd3af73445 req-5aa0c0e0-6146-4366-913b-eebc84216b57 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-692359135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817b22ed-b53b-4a3f-968b-3abd8977f361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fd20875ddca42a6b62937072f2722a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:42Z,use_quota=True,user_id='780ae39b91f8412e827dc05ce5d59bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Creating volume 817b22ed-b53b-4a3f-968b-3abd8977f361 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:42 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:42 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume volume-1647d38a-de84-4221-9217-bfefe252ce3b (1647d38a-de84-4221-9217-bfefe252ce3b): created successfully Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ada331-d4ff-4469-9c22-c0804b4ab654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:42 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 1073741824 Aug 28 16:26:42 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Flow 'volume_create_manager' (389d9328-df31-4233-a6a3-358f33dde526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cdab722a-4c28-4ed4-a5a7-753d467272e7 tempest-VolumeQuotasAdminTestJSON-1108018632 None] Created volume successfully. Aug 28 16:26:42 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-a7f6e967-3810-4204-aeef-cfbd3af73445 req-5aa0c0e0-6146-4366-913b-eebc84216b57 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a36da720-876b-4c5e-8454-963c0756d1c1', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:26:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-a7f6e967-3810-4204-aeef-cfbd3af73445 req-5aa0c0e0-6146-4366-913b-eebc84216b57 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] attachment_update completed successfully. Aug 28 16:26:43 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 1073741824" returned: 0 in 0.571s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:43 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 Aug 28 16:26:43 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:43 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361" returned: 0 in 0.304s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c66e55-5c64-495f-99e8-c56bdced75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817b22ed-b53b-4a3f-968b-3abd8977f361', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8bebd2-b3a4-40a0-b0f9-16fdaa03efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "cinder-1647d38a-de84-4221-9217-bfefe252ce3b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:43 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Volume volume-817b22ed-b53b-4a3f-968b-3abd8977f361 (817b22ed-b53b-4a3f-968b-3abd8977f361): created successfully Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8bebd2-b3a4-40a0-b0f9-16fdaa03efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Flow 'volume_create_manager' (9f0c9aa1-7c8c-44a2-9bd4-0694c895016b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "cinder-1647d38a-de84-4221-9217-bfefe252ce3b-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6d339f59-8f9e-46f6-b0ad-2fe7d69f6e49 tempest-VolumesServicesTestJSON-2030047540 None] Created volume successfully. Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "cinder-quobyte-1647d38a-de84-4221-9217-bfefe252ce3b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "cinder-quobyte-1647d38a-de84-4221-9217-bfefe252ce3b" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15439ba-762f-4dc4-81d5-10499de73f46]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:43 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b Aug 28 16:26:43 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Acquiring lock "cinder-817b22ed-b53b-4a3f-968b-3abd8977f361-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "cinder-817b22ed-b53b-4a3f-968b-3abd8977f361-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:44 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:44 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b Aug 28 16:26:44 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Acquiring lock "cinder-quobyte-817b22ed-b53b-4a3f-968b-3abd8977f361" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "cinder-quobyte-817b22ed-b53b-4a3f-968b-3abd8977f361" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6de9d1-c7ef-4e81-a5f8-c78d1df993d9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:44 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 Aug 28 16:26:44 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:44 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1647d38a-de84-4221-9217-bfefe252ce3b" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "cinder-quobyte-1647d38a-de84-4221-9217-bfefe252ce3b" released by "delete_volume" :: held 0.779s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Created reservations ['0427f44e-9c60-4d7a-8e75-cf769c758d2e', 'a413d63d-eeb6-493a-b305-c26ca0ec7021', 'bc469d00-7a82-4a79-822b-2d7e92920da8', 'd284056f-8c29-4e36-b49c-bd8da238596b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:44 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:44 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:44 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361" returned: 0 in 0.552s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:44 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361 Aug 28 16:26:44 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:45 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Deleted volume successfully. Aug 28 16:26:45 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e769c9be-a137-4862-b5a1-91be404559ba tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "cinder-1647d38a-de84-4221-9217-bfefe252ce3b-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-817b22ed-b53b-4a3f-968b-3abd8977f361" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "cinder-quobyte-817b22ed-b53b-4a3f-968b-3abd8977f361" released by "delete_volume" :: held 0.938s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Created reservations ['1956e202-a37d-447b-a050-32f34f6a2994', 'd3395c2e-6fbc-4608-beca-8b484450e306', 'bba90fcd-581c-44b5-84f5-65a2c0952ccf', '87897c32-e499-4186-b2ae-b1fe83a34d5d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:45 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:45 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-eeedab3b-64fd-439e-9653-e8a74b788cb5 req-424f5b4b-b67c-4d74-9d5c-fdfd71656791 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Terminate volume connection completed successfully. Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-eeedab3b-64fd-439e-9653-e8a74b788cb5 req-424f5b4b-b67c-4d74-9d5c-fdfd71656791 tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Deleting attachment a36da720-876b-4c5e-8454-963c0756d1c1. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:26:45 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.275s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Deleted volume successfully. Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9e4032ec-e3a9-43b5-9d21-a6fc5e826897 tempest-VolumesServicesTestJSON-2030047540 None] Lock "cinder-817b22ed-b53b-4a3f-968b-3abd8977f361-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Flow 'volume_create_manager' (a6543d89-a7ff-46d5-ba8d-3502a59a8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef63b5af-55bf-48f6-8342-93f1adbf980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef63b5af-55bf-48f6-8342-93f1adbf980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2073302187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b86e1ad-fac6-4b0c-8fc2-524f86f1a955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e459bca53e049199eecc6b14fae38ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:46Z,use_quota=True,user_id='de3bd4837d944d65a7d1d155b74f0893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ae9e0c-05ab-4ff2-aec8-0a5dcde376ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ae9e0c-05ab-4ff2-aec8-0a5dcde376ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908476dd-67fb-4cff-abac-b43a4233f2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908476dd-67fb-4cff-abac-b43a4233f2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b86e1ad-fac6-4b0c-8fc2-524f86f1a955', 'volume_name': 'volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76b8022-f52b-4ac3-a257-1bffd79ffa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76b8022-f52b-4ac3-a257-1bffd79ffa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9257f7ef-3c83-489a-83a0-882aa0697dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume 9b86e1ad-fac6-4b0c-8fc2-524f86f1a955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955', 'volume_size': 1} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2073302187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b86e1ad-fac6-4b0c-8fc2-524f86f1a955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e459bca53e049199eecc6b14fae38ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:46Z,use_quota=True,user_id='de3bd4837d944d65a7d1d155b74f0893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Creating volume 9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:45 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:45 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 1073741824 Aug 28 16:26:45 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:46 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 1073741824" returned: 0 in 0.487s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "cinder-466ae18f-3faf-44c4-938a-05f0ebd3d0c2-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "cinder-466ae18f-3faf-44c4-938a-05f0ebd3d0c2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:46 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 Aug 28 16:26:46 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "cinder-quobyte-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "cinder-quobyte-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70ea05c-5f5f-445d-84a4-621c603b8287]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:46 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 Aug 28 16:26:46 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:46 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" returned: 0 in 0.280s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9257f7ef-3c83-489a-83a0-882aa0697dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2027289d-08dd-470f-b02c-f0887388360e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Volume volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 (9b86e1ad-fac6-4b0c-8fc2-524f86f1a955): created successfully Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2027289d-08dd-470f-b02c-f0887388360e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Flow 'volume_create_manager' (a6543d89-a7ff-46d5-ba8d-3502a59a8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-015e726c-7e0c-4f4c-95b8-4a5022d868fc tempest-VolumeQuotasAdminTestJSON-1108018632 None] Created volume successfully. Aug 28 16:26:46 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" returned: 0 in 0.424s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:47 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2 Aug 28 16:26:47 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:47 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" returned: 0 in 0.283s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "cinder-quobyte-466ae18f-3faf-44c4-938a-05f0ebd3d0c2" released by "delete_volume" :: held 0.754s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Created reservations ['1caaef22-4f77-4fda-8361-98d089369c94', 'd4a8f002-0225-4014-ac61-a973c9628677', 'fb7aef27-b23f-4437-9b5c-590715beb616', 'b3d024a3-1fc7-4c95-acdb-4d83d0eab668'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:47 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:47 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:47 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Deleted volume successfully. Aug 28 16:26:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9d4cc2cf-fe07-43fb-861d-5885b1038a8c tempest-TestServerVolumeAttachScenarioOldVersion-1245246481 None] Lock "cinder-466ae18f-3faf-44c4-938a-05f0ebd3d0c2-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-faa90182-5e45-4bb5-a916-1ccb0aa858eb tempest-VolumeQuotasAdminTestJSON-652559060 None] Transfer volume completed successfully. Aug 28 16:26:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Acquiring lock "cinder-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "cinder-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:49 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=124,cinder:SELECT=110,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Acquiring lock "cinder-quobyte-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "cinder-quobyte-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[35694489-1635-4c7a-8a86-954139500a78]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:50 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 Aug 28 16:26:50 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:50 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" returned: 0 in 0.494s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:50 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955 Aug 28 16:26:50 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:50 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" returned: 0 in 0.278s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "cinder-quobyte-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955" released by "delete_volume" :: held 0.837s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:50 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Created reservations ['6323532b-44ec-4e46-9cba-9fc791cf283c', 'bf809afe-2076-4eec-90ae-d4cd196ff85e', '3b63206b-0171-4ef3-b157-7844f9e97baf', '2cc812cf-df12-4258-8e40-9fc14969c92f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:51 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:26:51 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:51 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.414s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:26:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Deleted volume successfully. Aug 28 16:26:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7b307c88-600c-48f2-90b8-cbcbc9f031cb tempest-VolumeQuotasAdminTestJSON-2116184114 None] Lock "cinder-9b86e1ad-fac6-4b0c-8fc2-524f86f1a955-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (b126eb37-6691-47de-958d-00ce3e8d4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9944b8ee-cc42-4dc9-a79a-743849e85114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9944b8ee-cc42-4dc9-a79a-743849e85114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-286620039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b292d2-b750-4b5e-8a15-80e2a8f798da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:54Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b53d234-e989-4db7-82ad-bf038cefdbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b53d234-e989-4db7-82ad-bf038cefdbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24083ac2-8ccd-4435-ae74-9ebbe57c172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24083ac2-8ccd-4435-ae74-9ebbe57c172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b292d2-b750-4b5e-8a15-80e2a8f798da', 'volume_name': 'volume-91b292d2-b750-4b5e-8a15-80e2a8f798da', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2445bee6-25ac-4741-bcac-e5bfc5d1ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2445bee6-25ac-4741-bcac-e5bfc5d1ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a9b581-aa54-4150-bdf2-f17c6144a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:54 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Volume 91b292d2-b750-4b5e-8a15-80e2a8f798da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b292d2-b750-4b5e-8a15-80e2a8f798da', 'volume_size': 1} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-286620039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b292d2-b750-4b5e-8a15-80e2a8f798da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:54Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Creating volume 91b292d2-b750-4b5e-8a15-80e2a8f798da {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:54 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:54 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da 1073741824 Aug 28 16:26:54 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:54 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da 1073741824" returned: 0 in 0.483s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:54 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da Aug 28 16:26:54 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:55 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da" returned: 0 in 0.274s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a9b581-aa54-4150-bdf2-f17c6144a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b292d2-b750-4b5e-8a15-80e2a8f798da', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fc8c3f-2c36-4d0e-b9a4-f047c56a5b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:55 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Volume volume-91b292d2-b750-4b5e-8a15-80e2a8f798da (91b292d2-b750-4b5e-8a15-80e2a8f798da): created successfully Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fc8c3f-2c36-4d0e-b9a4-f047c56a5b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:55 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (b126eb37-6691-47de-958d-00ce3e8d4227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-eea13e64-fcd2-46ba-838a-819a61ba8397 tempest-VolumesListAdminTestJSON-1996601377 None] Created volume successfully. Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (5046684c-3a73-4752-b52b-406d58de586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ab3695-a7ae-4dd0-a0b2-0f5ff1f4a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ab3695-a7ae-4dd0-a0b2-0f5ff1f4a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38872252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5c9d03-62ae-4505-90a2-22894ad7e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:57Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f602c2-5956-453c-99d5-33722da840fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f602c2-5956-453c-99d5-33722da840fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb7d4e1-bdac-4542-9fbe-e784242768e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb7d4e1-bdac-4542-9fbe-e784242768e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5c9d03-62ae-4505-90a2-22894ad7e8d1', 'volume_name': 'volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25401dae-fab7-424e-bc15-8dfcbe8d4763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25401dae-fab7-424e-bc15-8dfcbe8d4763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864e311f-e2d7-4f87-961d-c4adb5b2a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:57 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Volume bf5c9d03-62ae-4505-90a2-22894ad7e8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1', 'volume_size': 1} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38872252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5c9d03-62ae-4505-90a2-22894ad7e8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:26:57Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Creating volume bf5c9d03-62ae-4505-90a2-22894ad7e8d1 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:57 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:57 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 1073741824 Aug 28 16:26:57 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:57 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 1073741824" returned: 0 in 0.511s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:57 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 Aug 28 16:26:57 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:26:58 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" returned: 0 in 0.284s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864e311f-e2d7-4f87-961d-c4adb5b2a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f794c9a-bf84-4d50-9982-85963b96dec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Volume volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 (bf5c9d03-62ae-4505-90a2-22894ad7e8d1): created successfully Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f794c9a-bf84-4d50-9982-85963b96dec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (5046684c-3a73-4752-b52b-406d58de586e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9af47389-99c4-4eee-912f-c5f9825bc9ff tempest-VolumesListAdminTestJSON-1996601377 None] Created volume successfully. Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (bac687df-5a19-4efc-930b-60fa5e4b1ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f12bdd-3485-4c7c-a2ed-1ad508d7fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f12bdd-3485-4c7c-a2ed-1ad508d7fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1566339195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c726cd8-1ccb-4cec-aa06-73b996146496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:00Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879a242-bec6-473a-8ce1-418b30163198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879a242-bec6-473a-8ce1-418b30163198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ae8d78-f415-4d46-84af-b3fd4118b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ae8d78-f415-4d46-84af-b3fd4118b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c726cd8-1ccb-4cec-aa06-73b996146496', 'volume_name': 'volume-5c726cd8-1ccb-4cec-aa06-73b996146496', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e9a93f-58b2-48b4-8fdd-35ae6bee41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e9a93f-58b2-48b4-8fdd-35ae6bee41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f846e259-06d7-45b5-8db6-f0dc8827b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:26:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Volume 5c726cd8-1ccb-4cec-aa06-73b996146496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c726cd8-1ccb-4cec-aa06-73b996146496', 'volume_size': 1} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1566339195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c726cd8-1ccb-4cec-aa06-73b996146496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f472dc035f894fb88ba7f8412cfa3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:00Z,use_quota=True,user_id='9a082d3595bf440286786b7690cda5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Creating volume 5c726cd8-1ccb-4cec-aa06-73b996146496 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:26:59 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:26:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:26:59 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 1073741824 Aug 28 16:26:59 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:00 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 1073741824" returned: 0 in 0.539s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:00 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 Aug 28 16:27:00 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:00 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496" returned: 0 in 0.263s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f846e259-06d7-45b5-8db6-f0dc8827b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c726cd8-1ccb-4cec-aa06-73b996146496', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3b66f-f9d2-4e4f-b0e3-20010dfb52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Volume volume-5c726cd8-1ccb-4cec-aa06-73b996146496 (5c726cd8-1ccb-4cec-aa06-73b996146496): created successfully Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e3b66f-f9d2-4e4f-b0e3-20010dfb52d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Flow 'volume_create_manager' (bac687df-5a19-4efc-930b-60fa5e4b1ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c46904c8-0543-497f-a00d-562dbe73a11b tempest-VolumesListAdminTestJSON-1996601377 None] Created volume successfully. Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Flow 'volume_create_manager' (fb6c3465-3211-4202-8684-68a8783e712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93dbe915-cae2-4d3b-a9ec-61fc00ea6bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93dbe915-cae2-4d3b-a9ec-61fc00ea6bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab5c8f9-846b-4ad9-8176-58a6f980ca62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e0df6d191e478aa3ee52b0ed43063e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:03Z,use_quota=True,user_id='ab8105181a5e4e0dab29d35bd8ddc806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e453583-fd33-4393-abce-298e718cfbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e453583-fd33-4393-abce-298e718cfbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87024146-edad-4c42-8b22-ed5731a40cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87024146-edad-4c42-8b22-ed5731a40cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab5c8f9-846b-4ad9-8176-58a6f980ca62', 'volume_name': 'volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc2e75-70ae-4089-b738-f492dcf3ff11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdc2e75-70ae-4089-b738-f492dcf3ff11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df8e35-4071-49b4-a1d7-6a791a53eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Volume bab5c8f9-846b-4ad9-8176-58a6f980ca62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62', 'volume_size': 1} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab5c8f9-846b-4ad9-8176-58a6f980ca62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e0df6d191e478aa3ee52b0ed43063e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:03Z,use_quota=True,user_id='ab8105181a5e4e0dab29d35bd8ddc806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Creating volume bab5c8f9-846b-4ad9-8176-58a6f980ca62 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:03 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 1073741824 Aug 28 16:27:03 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:03 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 1073741824" returned: 0 in 0.546s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:03 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 Aug 28 16:27:03 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:03 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df8e35-4071-49b4-a1d7-6a791a53eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d80fed-f62d-43c2-8f26-909aa026e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Volume volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 (bab5c8f9-846b-4ad9-8176-58a6f980ca62): created successfully Aug 28 16:27:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1d80fed-f62d-43c2-8f26-909aa026e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Flow 'volume_create_manager' (fb6c3465-3211-4202-8684-68a8783e712b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-257d4378-8d0b-4f86-9718-261dbd5e6f17 tempest-VolumesListAdminTestJSON-474149336 None] Created volume successfully. Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Acquiring lock "cinder-bab5c8f9-846b-4ad9-8176-58a6f980ca62-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "cinder-bab5c8f9-846b-4ad9-8176-58a6f980ca62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Acquiring lock "cinder-quobyte-bab5c8f9-846b-4ad9-8176-58a6f980ca62" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "cinder-quobyte-bab5c8f9-846b-4ad9-8176-58a6f980ca62" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[df702740-2494-4d24-9dab-6c1361f61688]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-5c726cd8-1ccb-4cec-aa06-73b996146496-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-5c726cd8-1ccb-4cec-aa06-73b996146496-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-quobyte-5c726cd8-1ccb-4cec-aa06-73b996146496" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-5c726cd8-1ccb-4cec-aa06-73b996146496" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1719b2-8070-4d5b-9fc2-8587677f8458]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:05 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 Aug 28 16:27:05 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:05 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 Aug 28 16:27:05 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:05 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62" returned: 0 in 0.569s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:05 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62 Aug 28 16:27:05 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:05 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496" returned: 0 in 0.499s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:05 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496 Aug 28 16:27:05 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:06 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bab5c8f9-846b-4ad9-8176-58a6f980ca62" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "cinder-quobyte-bab5c8f9-846b-4ad9-8176-58a6f980ca62" released by "delete_volume" :: held 1.000s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:06 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5c726cd8-1ccb-4cec-aa06-73b996146496" returned: 0 in 0.345s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-5c726cd8-1ccb-4cec-aa06-73b996146496" released by "delete_volume" :: held 0.900s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Created reservations ['aae79e6a-9a40-4ffc-99bf-b8d9625e7ab8', 'a21e7671-ac47-4550-86c5-c6d33ad43696', 'f990c463-564f-4df5-80af-94a74e2d81ff', '981dd763-e200-4992-beed-1bd2da6e9fd9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Created reservations ['17d69284-2b02-40df-b665-f36c4c519c23', 'f29784cf-c40b-44aa-aad7-c93131f67b76', 'cc85766d-11f0-429a-a602-607f90c555c6', '84149eaf-0fe7-49d5-a5eb-91aecfc5be01'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:06 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:06 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:06 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:06 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-bf5c9d03-62ae-4505-90a2-22894ad7e8d1-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-bf5c9d03-62ae-4505-90a2-22894ad7e8d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-quobyte-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290fefa-73ff-414b-a962-c56aae652adf]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:06 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.391s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:06 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Deleted volume successfully. Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53205831-b294-4518-aa8e-0ae5e2684c94 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-5c726cd8-1ccb-4cec-aa06-73b996146496-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:07 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.558s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Deleted volume successfully. Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8838ac86-2245-4ca2-9a26-9f188d31bc67 tempest-VolumesListAdminTestJSON-474149336 None] Lock "cinder-bab5c8f9-846b-4ad9-8176-58a6f980ca62-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:07 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 Aug 28 16:27:07 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:07 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" returned: 0 in 0.580s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:07 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1 Aug 28 16:27:07 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:07 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" returned: 0 in 0.322s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-bf5c9d03-62ae-4505-90a2-22894ad7e8d1" released by "delete_volume" :: held 0.985s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Created reservations ['9b48229f-31ff-468f-b78d-0ec96e8225f7', '252ed75a-e9e1-4115-a3a1-d5a76d5c9d32', '69c80507-da14-4a2c-bbf7-a9c22f63cae5', '10cc8726-7058-4d57-a768-8632f1b41b24'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:08 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:08 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:08 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.488s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Deleted volume successfully. Aug 28 16:27:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-153f8ee5-f97b-4a20-807a-42e5db51f678 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-bf5c9d03-62ae-4505-90a2-22894ad7e8d1-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-91b292d2-b750-4b5e-8a15-80e2a8f798da-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-91b292d2-b750-4b5e-8a15-80e2a8f798da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "cinder-quobyte-91b292d2-b750-4b5e-8a15-80e2a8f798da" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-91b292d2-b750-4b5e-8a15-80e2a8f798da" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fcd3f1-fb1e-4aed-ac43-ef97763430ae]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:09 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da Aug 28 16:27:09 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:09 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da" returned: 0 in 0.508s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:09 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da Aug 28 16:27:09 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:10 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-91b292d2-b750-4b5e-8a15-80e2a8f798da" returned: 0 in 0.458s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-quobyte-91b292d2-b750-4b5e-8a15-80e2a8f798da" released by "delete_volume" :: held 1.020s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Created reservations ['31798641-2ba3-4989-aa4e-f5b22791f38e', '58292bb0-09fc-4d79-a4e7-2cc33d02f1ad', '64da202f-9912-495b-a0b6-11fb76e28d6e', '71ff6ded-3df9-489b-9a12-90c761249673'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:10 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:10 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-6b70c49c-b859-4a6e-ac82-34a6f1b4b91f req-d9666dd7-2262-4115-bc41-dfa71d481695 tempest-TestMinimumBasicScenario-1610993501 None] Terminate volume connection completed successfully. Aug 28 16:27:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-6b70c49c-b859-4a6e-ac82-34a6f1b4b91f req-d9666dd7-2262-4115-bc41-dfa71d481695 tempest-TestMinimumBasicScenario-1610993501 None] Deleting attachment 90b51d98-1c11-4b27-904a-74688e6fd4f2. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:27:10 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Deleted volume successfully. Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f20fad99-677a-4d60-a83e-0537216e23a8 tempest-VolumesListAdminTestJSON-1996601377 None] Lock "cinder-91b292d2-b750-4b5e-8a15-80e2a8f798da-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "cinder-d33f96b9-c978-4bcf-8957-4ebe4a676e50-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "cinder-d33f96b9-c978-4bcf-8957-4ebe4a676e50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "cinder-quobyte-d33f96b9-c978-4bcf-8957-4ebe4a676e50" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "cinder-quobyte-d33f96b9-c978-4bcf-8957-4ebe4a676e50" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6db01d-7a9a-4855-902a-a4d24b270914]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:12 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 Aug 28 16:27:12 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:12 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50" returned: 0 in 0.625s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:12 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50 Aug 28 16:27:12 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:12 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d33f96b9-c978-4bcf-8957-4ebe4a676e50" returned: 0 in 0.333s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "cinder-quobyte-d33f96b9-c978-4bcf-8957-4ebe4a676e50" released by "delete_volume" :: held 1.034s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Created reservations ['cd44a17b-8107-4fd4-be9d-9db1b96a589f', '0baad902-eda5-49ce-930f-284324f8a51b', '4b75cd0a-e037-40a1-bd0a-5bcd6ede5b52', 'b746034c-62aa-4c09-94e0-7f0a889e2543'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:13 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:13 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:13 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Deleted volume successfully. Aug 28 16:27:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a5a69c05-5869-4195-add8-9fe7726f5ade tempest-TestMinimumBasicScenario-1610993501 None] Lock "cinder-d33f96b9-c978-4bcf-8957-4ebe4a676e50-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (818bff70-df3f-4c6c-a786-259605bc42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b315853-15a2-453c-b108-cdd5c7362a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b315853-15a2-453c-b108-cdd5c7362a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1464751606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d777f03d-b7c5-4737-91b6-7aaedb3ba422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcb338712c14435916582c7c5e23cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:17Z,use_quota=True,user_id='317fa3d97e8b48e8bf80666fbbfc7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f402000-6a73-4306-9e18-29c660b45470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f402000-6a73-4306-9e18-29c660b45470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbb0145-52d5-455a-8461-d77fc1fad609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbb0145-52d5-455a-8461-d77fc1fad609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd777f03d-b7c5-4737-91b6-7aaedb3ba422', 'volume_name': 'volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9497d2b9-cf56-482c-8c1a-30d3fc2bd89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9497d2b9-cf56-482c-8c1a-30d3fc2bd89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebc845f-2b4d-4042-94e2-d3429ae54234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:17 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Volume d777f03d-b7c5-4737-91b6-7aaedb3ba422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422', 'volume_size': 1} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1464751606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d777f03d-b7c5-4737-91b6-7aaedb3ba422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcb338712c14435916582c7c5e23cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:17Z,use_quota=True,user_id='317fa3d97e8b48e8bf80666fbbfc7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Creating volume d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:17 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:17 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 1073741824 Aug 28 16:27:17 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:17 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 1073741824" returned: 0 in 0.539s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:17 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 Aug 28 16:27:17 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:18 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebc845f-2b4d-4042-94e2-d3429ae54234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a29adbc-b70c-4ff0-a96c-3f630e5f62bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:18 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Volume volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 (d777f03d-b7c5-4737-91b6-7aaedb3ba422): created successfully Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a29adbc-b70c-4ff0-a96c-3f630e5f62bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (818bff70-df3f-4c6c-a786-259605bc42b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9768fca8-bc02-47a3-a4ba-e2a8a03a9dd6 tempest-VolumesDeleteCascade-1901408713 None] Created volume successfully. Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Flow 'volume_create_manager' (728ce25f-56f9-4889-abac-90e306aa1e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7ffe28-ae7a-49d9-80e4-9231278694b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7ffe28-ae7a-49d9-80e4-9231278694b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-450342655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee8b914-24c1-4f50-b8e2-0d5e0e5093df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcae533b85d5455e970a360b4a5d98ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:19Z,use_quota=True,user_id='f0ce7e128b6847c39a690d5abe683e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e5bc03-1aff-459d-8b4b-f01f7ca773a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e5bc03-1aff-459d-8b4b-f01f7ca773a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c073e4-9b06-4dd7-9193-ead9f6c16ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c073e4-9b06-4dd7-9193-ead9f6c16ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee8b914-24c1-4f50-b8e2-0d5e0e5093df', 'volume_name': 'volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c3a3e7-fe16-462b-817b-06ad2e83a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c3a3e7-fe16-462b-817b-06ad2e83a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64887d20-5c06-49be-bad5-94e94c8e8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:19 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Volume 2ee8b914-24c1-4f50-b8e2-0d5e0e5093df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df', 'volume_size': 1} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-450342655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee8b914-24c1-4f50-b8e2-0d5e0e5093df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcae533b85d5455e970a360b4a5d98ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:19Z,use_quota=True,user_id='f0ce7e128b6847c39a690d5abe683e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Creating volume 2ee8b914-24c1-4f50-b8e2-0d5e0e5093df {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:19 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:19 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df 1073741824 Aug 28 16:27:19 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:19 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df 1073741824" returned: 0 in 0.544s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:19 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df Aug 28 16:27:19 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:20 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" returned: 0 in 0.266s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.572s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64887d20-5c06-49be-bad5-94e94c8e8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce1873-6eae-44c2-9857-a1712d7f09ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Creating offline snapshot e6879faa-1f2f-4a16-8320-440e2f683ac4 of volume d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:27:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Volume volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df (2ee8b914-24c1-4f50-b8e2-0d5e0e5093df): created successfully Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ce1873-6eae-44c2-9857-a1712d7f09ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Flow 'volume_create_manager' (728ce25f-56f9-4889-abac-90e306aa1e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910bce3-4ff0-453c-89ac-66474834ca38]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a881e01e-b437-4bca-af10-f83abb869dba tempest-VolumesTransfersTest-1892668683 None] Created volume successfully. Aug 28 16:27:20 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 Aug 28 16:27:20 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:20 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422" returned: 0 in 0.380s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:20 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 1G Aug 28 16:27:20 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:20 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 1G" returned: 0 in 0.391s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:21 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:21 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:21 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:21 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 is being set with open permissions: ugo+rw Aug 28 16:27:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:21 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:21 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:21 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:21 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info Aug 28 16:27:21 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:22 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2084cfd1-d9f6-49e2-a9b8-626a7f094194 tempest-VolumesTransfersTest-270654374 None] Transfer volume completed successfully. Aug 28 16:27:22 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:22 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info is being set with open permissions: ugo+rw Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:22 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info Aug 28 16:27:22 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:22 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.info" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:22 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a32e3fab-d0b2-4b54-a8e5-735a16e46d68 tempest-VolumesDeleteCascade-1901408713 None] Create snapshot completed successfully Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "cinder-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "cinder-quobyte-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-quobyte-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b503c9-7356-458c-97d6-02d0cc6950a1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:22 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df Aug 28 16:27:22 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Creating offline snapshot 01b33588-299b-467f-9915-b7eb2f1fa32e of volume d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee833aae-f302-43b5-8519-953566163a63]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:23 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:23 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:23 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:23 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df Aug 28 16:27:23 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:23 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" returned: 0 in 0.264s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:23 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.434s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-quobyte-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df" released by "delete_volume" :: held 0.761s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:23 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e 1G Aug 28 16:27:23 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Created reservations ['a625868e-d0b3-4ecc-9ad6-9b472c543147', 'e271b445-a80f-46f0-b3d7-41fa40e15202', '59d2e81b-dd2c-4c4c-9c5f-06532782efdb', '3ee2d4ac-5981-4d27-b6a1-3fb66593bf7f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:23 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:23 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:23 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.280s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:23 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Deleted volume successfully. Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a8446c10-4917-4aff-b80f-46ba1cde80b4 tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-2ee8b914-24c1-4f50-b8e2-0d5e0e5093df-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:23 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e 1G" returned: 0 in 0.577s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:24 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e Aug 28 16:27:24 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:24 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e" returned: 0 in 0.324s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:24 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e is being set with open permissions: ugo+rw Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:24 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e Aug 28 16:27:24 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Flow 'volume_create_manager' (fce4da99-9e09-405f-afdc-de3f4a520acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b1260d-5d08-42ac-84ea-6119a418ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b1260d-5d08-42ac-84ea-6119a418ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-603869390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9864154e-d186-4106-8003-377eb4190863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcae533b85d5455e970a360b4a5d98ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:24Z,use_quota=True,user_id='f0ce7e128b6847c39a690d5abe683e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6b634a-3e8f-4190-91db-c357289ff618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6b634a-3e8f-4190-91db-c357289ff618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e3e8c1-8f2e-40e7-be47-27ed4201b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e3e8c1-8f2e-40e7-be47-27ed4201b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9864154e-d186-4106-8003-377eb4190863', 'volume_name': 'volume-9864154e-d186-4106-8003-377eb4190863', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1bc7aa-7880-45ef-883a-ced3fb5254c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1bc7aa-7880-45ef-883a-ced3fb5254c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915aa069-5551-4509-a346-ca1f16b0a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Volume 9864154e-d186-4106-8003-377eb4190863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9864154e-d186-4106-8003-377eb4190863', 'volume_size': 1} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:24 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.728s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-603869390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9864154e-d186-4106-8003-377eb4190863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcae533b85d5455e970a360b4a5d98ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:24Z,use_quota=True,user_id='f0ce7e128b6847c39a690d5abe683e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Creating volume 9864154e-d186-4106-8003-377eb4190863 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:24 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:24 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 1073741824 Aug 28 16:27:24 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9e9766cf-09e2-48ca-89f8-952b23a6df61 tempest-VolumesDeleteCascade-1901408713 None] Create snapshot completed successfully Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-d777f03d-b7c5-4737-91b6-7aaedb3ba422-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-d777f03d-b7c5-4737-91b6-7aaedb3ba422-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:25 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 1073741824" returned: 0 in 0.509s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Performing cascade delete. {{(pid=86193) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-01b33588-299b-467f-9915-b7eb2f1fa32e-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:25 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 Aug 28 16:27:25 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-01b33588-299b-467f-9915-b7eb2f1fa32e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-01b33588-299b-467f-9915-b7eb2f1fa32e" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-01b33588-299b-467f-9915-b7eb2f1fa32e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Deleting offline snapshot 01b33588-299b-467f-9915-b7eb2f1fa32e of volume d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] snapshot_file for this snap is: volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1419a4-9e1f-49a1-b5b0-f24de6322bd4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:25 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e Aug 28 16:27:25 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:25 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863" returned: 0 in 0.307s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915aa069-5551-4509-a346-ca1f16b0a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9864154e-d186-4106-8003-377eb4190863', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dea284e-b396-4c90-aac0-279cc6c2ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Volume volume-9864154e-d186-4106-8003-377eb4190863 (9864154e-d186-4106-8003-377eb4190863): created successfully Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dea284e-b396-4c90-aac0-279cc6c2ca19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Flow 'volume_create_manager' (fce4da99-9e09-405f-afdc-de3f4a520acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2d1be80b-7598-4449-bedc-9e30560ce8fd tempest-VolumesTransfersTest-1892668683 None] Created volume successfully. Aug 28 16:27:25 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e" returned: 0 in 0.380s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee97657-de3d-48ed-8471-efd4c3fe3740]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:25 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:25 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:26 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:26 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e Aug 28 16:27:26 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:26 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e" returned: 0 in 0.575s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:26 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e Aug 28 16:27:26 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "cinder-9864154e-d186-4106-8003-377eb4190863-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-9864154e-d186-4106-8003-377eb4190863-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:26 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=158,cinder:SELECT=113,cinder:DELETE=14,cinder:INSERT=31 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "cinder-quobyte-9864154e-d186-4106-8003-377eb4190863" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-quobyte-9864154e-d186-4106-8003-377eb4190863" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe656934-d6ae-4af9-818d-c93a447adb22]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:27 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.01b33588-299b-467f-9915-b7eb2f1fa32e" returned: 0 in 0.409s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-01b33588-299b-467f-9915-b7eb2f1fa32e" released by "_delete_snapshot" :: held 1.851s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" released by "delete_snapshot" :: held 1.882s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:27 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 Aug 28 16:27:27 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['2db89b52-971a-4fdf-b120-a0d3f600bd6e', '38ff1df4-f9d7-4f0a-9f51-70ade8c7b607', '943ff67b-3159-44d6-8da1-7de38a115b61', 'fdca48a4-ea61-4303-93c2-eeb685b70aba'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Delete snapshot completed successfully. Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-01b33588-299b-467f-9915-b7eb2f1fa32e-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-e6879faa-1f2f-4a16-8320-440e2f683ac4-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-e6879faa-1f2f-4a16-8320-440e2f683ac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-e6879faa-1f2f-4a16-8320-440e2f683ac4" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-e6879faa-1f2f-4a16-8320-440e2f683ac4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Deleting offline snapshot e6879faa-1f2f-4a16-8320-440e2f683ac4 of volume d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] snapshot_file for this snap is: volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e13795-df5d-4eb7-acff-1684868deba4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:27 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863" returned: 0 in 0.501s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:27 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863 Aug 28 16:27:27 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:27 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:27 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:27 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9864154e-d186-4106-8003-377eb4190863" returned: 0 in 0.282s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-quobyte-9864154e-d186-4106-8003-377eb4190863" released by "delete_volume" :: held 0.833s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:27 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.471s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Created reservations ['5e67127f-ad31-4d6d-8634-9d991c7d1cc6', 'c406ed8b-de9a-4acc-9e93-7ed4a7ba396c', '239e3a23-731a-4c32-a611-da8043fe8102', '875c5e6a-01e9-4a19-be06-83894a6d2f51'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0076e6c0-3e34-4a9b-9a69-d86feab07825]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:28 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:28 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:28 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 Aug 28 16:27:28 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:28 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Deleted volume successfully. Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0566cec6-4cc3-4178-8efe-c69f255c7b0e tempest-VolumesTransfersTest-1575254949 None] Lock "cinder-9864154e-d186-4106-8003-377eb4190863-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:28 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422" returned: 0 in 0.525s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:28 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:28 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:28 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:28 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4 Aug 28 16:27:28 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:29 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422.e6879faa-1f2f-4a16-8320-440e2f683ac4" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-e6879faa-1f2f-4a16-8320-440e2f683ac4" released by "_delete_snapshot" :: held 1.866s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" released by "delete_snapshot" :: held 1.897s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['c0742491-7ffa-41a6-b855-e82fb91065a7', '94b42b98-253c-479b-bd30-b49a15a5559b', 'cb0783a3-9bef-4d8d-b9a9-77b5f5718b4a', 'eda4fc7b-8066-4faa-ba34-8cd86d4decd3'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Delete snapshot completed successfully. Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-e6879faa-1f2f-4a16-8320-440e2f683ac4-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Snapshots deleted, issuing volume delete {{(pid=86193) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe00b90-ed85-4629-9446-e686c8ce49e1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:29 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 Aug 28 16:27:29 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:30 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:30 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422 Aug 28 16:27:30 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:30 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d777f03d-b7c5-4737-91b6-7aaedb3ba422" returned: 0 in 0.326s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-d777f03d-b7c5-4737-91b6-7aaedb3ba422" released by "delete_volume" :: held 0.941s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['fe1dc380-a6e6-491c-a6ac-8f885789c767', 'c8da6d8c-2bfb-49ba-ac54-cece4eb35695', '7342a025-db3e-4120-9a7f-f1105e25ffaf', '9994a5f3-c304-4fcb-8e77-21dcfb79c714'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:30 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:30 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:30 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Deleted volume successfully. Aug 28 16:27:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9bf9b782-9000-464f-9906-0401c09651a2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-d777f03d-b7c5-4737-91b6-7aaedb3ba422-delete_volume" released by "delete_volume" :: held 5.858s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:31 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:31 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (f797da0e-4fff-4b30-a78c-2f194d068186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0f8e1-064a-4fdc-939c-427c536eb0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc0f8e1-064a-4fdc-939c-427c536eb0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1190250296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941f31b3-e5c9-40ac-85e7-34418bf998a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcb338712c14435916582c7c5e23cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:32Z,use_quota=True,user_id='317fa3d97e8b48e8bf80666fbbfc7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0c24b6-4c91-4008-a773-899fe744c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0c24b6-4c91-4008-a773-899fe744c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ae4f1c-94ab-412a-85b3-d528dba9a12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ae4f1c-94ab-412a-85b3-d528dba9a12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941f31b3-e5c9-40ac-85e7-34418bf998a3', 'volume_name': 'volume-941f31b3-e5c9-40ac-85e7-34418bf998a3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78294387-29b4-444f-82c7-64fbdee27d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78294387-29b4-444f-82c7-64fbdee27d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9db1ca3-8454-457c-b01f-e061f756bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:31 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Volume 941f31b3-e5c9-40ac-85e7-34418bf998a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941f31b3-e5c9-40ac-85e7-34418bf998a3', 'volume_size': 1} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1190250296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941f31b3-e5c9-40ac-85e7-34418bf998a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcb338712c14435916582c7c5e23cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:32Z,use_quota=True,user_id='317fa3d97e8b48e8bf80666fbbfc7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Creating volume 941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:31 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:31 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.337s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:31 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 1073741824 Aug 28 16:27:31 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:27:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:27:32 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 1073741824" returned: 0 in 0.606s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:32 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:32 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:32 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9db1ca3-8454-457c-b01f-e061f756bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941f31b3-e5c9-40ac-85e7-34418bf998a3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a917846-5287-4d6a-b032-b4cea9c3861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:32 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Volume volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 (941f31b3-e5c9-40ac-85e7-34418bf998a3): created successfully Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a917846-5287-4d6a-b032-b4cea9c3861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (f797da0e-4fff-4b30-a78c-2f194d068186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-21ee1b4d-1e43-4177-98a0-ec38ec5b2130 tempest-VolumesDeleteCascade-1901408713 None] Created volume successfully. Aug 28 16:27:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Creating offline snapshot b86419f3-43d4-4471-815b-955a167a47dc of volume 941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:27:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e37a4-c974-49a9-a468-8d82c0613f82]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:34 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:34 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:34 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.432s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:34 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc 1G Aug 28 16:27:34 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:34 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc 1G" returned: 0 in 0.501s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:34 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:34 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:35 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:35 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc is being set with open permissions: ugo+rw Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:35 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:35 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:35 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.281s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:35 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info Aug 28 16:27:35 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:35 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info" returned: 0 in 0.282s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:35 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info is being set with open permissions: ugo+rw Aug 28 16:27:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:35 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info Aug 28 16:27:35 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:36 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.info" returned: 0 in 0.294s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ba28f86c-77f4-4c79-9107-04e4d519660f tempest-VolumesDeleteCascade-1901408713 None] Create snapshot completed successfully Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Flow 'volume_create_manager' (5220e4d7-0a02-40e3-bc74-00a9a05b1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ced065-27b0-4c08-a8b8-56f987cdb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ced065-27b0-4c08-a8b8-56f987cdb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-951173676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec23b505-6b66-41b9-87a5-32a29795edc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073eeb8ef90242ff9705bb1a7ba8b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:37Z,use_quota=True,user_id='954637561ca5494bae91fb13c39b827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097c3d7-fd01-45aa-bdad-489209bdbd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1097c3d7-fd01-45aa-bdad-489209bdbd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba856d5-8464-48a3-bfd2-8e6e8b4712d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba856d5-8464-48a3-bfd2-8e6e8b4712d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec23b505-6b66-41b9-87a5-32a29795edc7', 'volume_name': 'volume-ec23b505-6b66-41b9-87a5-32a29795edc7', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c92a4-3f0f-47af-a546-3f044a568971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c92a4-3f0f-47af-a546-3f044a568971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137e5f1a-e95f-427e-b339-7397b8e80a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Volume ec23b505-6b66-41b9-87a5-32a29795edc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec23b505-6b66-41b9-87a5-32a29795edc7', 'volume_size': 1} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-951173676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec23b505-6b66-41b9-87a5-32a29795edc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073eeb8ef90242ff9705bb1a7ba8b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:37Z,use_quota=True,user_id='954637561ca5494bae91fb13c39b827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Creating volume ec23b505-6b66-41b9-87a5-32a29795edc7 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:37 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:37 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 1073741824 Aug 28 16:27:37 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (009a19eb-bc0f-4d80-971a-a791ac0eb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7948845e-6533-46e3-85a4-c1958749231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7948845e-6533-46e3-85a4-c1958749231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1912446723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882f6f58-6a41-4778-bea5-b2c7ca0946da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcb338712c14435916582c7c5e23cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b86419f3-43d4-4471-815b-955a167a47dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:38Z,use_quota=True,user_id='317fa3d97e8b48e8bf80666fbbfc7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf6ec9e-e911-408d-baf5-95a73383b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf6ec9e-e911-408d-baf5-95a73383b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca34bc1-8a3f-4ce0-9e79-c75c8ba1fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca34bc1-8a3f-4ce0-9e79-c75c8ba1fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '882f6f58-6a41-4778-bea5-b2c7ca0946da', 'volume_name': 'volume-882f6f58-6a41-4778-bea5-b2c7ca0946da', 'volume_size': 1, 'snapshot_id': 'b86419f3-43d4-4471-815b-955a167a47dc'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b221743-abb6-4f3a-b933-d2046b3b6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b221743-abb6-4f3a-b933-d2046b3b6700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43985890-2f37-4d8e-86c3-2404abe7f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:37 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Volume 882f6f58-6a41-4778-bea5-b2c7ca0946da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-882f6f58-6a41-4778-bea5-b2c7ca0946da', 'volume_size': 1, 'snapshot_id': 'b86419f3-43d4-4471-815b-955a167a47dc'} Aug 28 16:27:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:38 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 1073741824" returned: 0 in 0.736s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:38 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 Aug 28 16:27:38 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:38 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.466s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc-882f6f58-6a41-4778-bea5-b2c7ca0946da" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137e5f1a-e95f-427e-b339-7397b8e80a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec23b505-6b66-41b9-87a5-32a29795edc7', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f7735c-766a-499b-af3c-014def86e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc-882f6f58-6a41-4778-bea5-b2c7ca0946da" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Creating volume 882f6f58-6a41-4778-bea5-b2c7ca0946da from snapshot b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:38 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Volume volume-ec23b505-6b66-41b9-87a5-32a29795edc7 (ec23b505-6b66-41b9-87a5-32a29795edc7): created successfully Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f7735c-766a-499b-af3c-014def86e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Flow 'volume_create_manager' (5220e4d7-0a02-40e3-bc74-00a9a05b1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] snapshot: b86419f3-43d4-4471-815b-955a167a47dc, volume: 882f6f58-6a41-4778-bea5-b2c7ca0946da, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:27:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1f1e9f9d-0888-4841-82fc-f04d1ecbc568 tempest-VolumesTransfersV355Test-337155639 None] Created volume successfully. Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d833e1-7b60-498f-9104-472d9120794a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:38 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:38 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:39 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-941f31b3-e5c9-40ac-85e7-34418bf998a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d70503-733e-4f48-8df1-70e682a36371]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:39 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:39 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:39 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.443s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:27:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:39 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da Aug 28 16:27:39 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f2415a19-03aa-414a-9f8d-8f84dda625cb tempest-VolumesTransfersV355Test-873780681 None] Transfer volume completed successfully. Aug 28 16:27:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "cinder-ec23b505-6b66-41b9-87a5-32a29795edc7-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-ec23b505-6b66-41b9-87a5-32a29795edc7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "cinder-quobyte-ec23b505-6b66-41b9-87a5-32a29795edc7" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-quobyte-ec23b505-6b66-41b9-87a5-32a29795edc7" acquired by "delete_volume" :: waited 0.063s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6333a1-ec4a-493e-b015-5716a3b17c83]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:42 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 Aug 28 16:27:42 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:43 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7" returned: 0 in 0.996s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:43 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7 Aug 28 16:27:43 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:43 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec23b505-6b66-41b9-87a5-32a29795edc7" returned: 0 in 0.639s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-quobyte-ec23b505-6b66-41b9-87a5-32a29795edc7" released by "delete_volume" :: held 1.807s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Created reservations ['3f48e110-d367-41ad-8d28-a9f9df6bb2eb', '6219e374-e0ee-4a53-aa56-d78a40b37aef', '480bc6dd-ecb1-482f-b996-6b41133c63f5', '591ee0d4-bd04-41da-bdb3-6e0b7007d7ec'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:44 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:44 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:45 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.783s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Deleted volume successfully. Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c9580916-beb5-4e21-957c-7f2011625bc9 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-ec23b505-6b66-41b9-87a5-32a29795edc7-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:45 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da" returned: 0 in 6.141s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:27:45 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Converted 1024.00 MB image at 166.71 MB/s Aug 28 16:27:45 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da is being set with open permissions: ugo+rw Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:45 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da Aug 28 16:27:45 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Flow 'volume_create_manager' (e0f3e689-0b8a-4fd5-8e61-53a6ab27f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e16ed6-d9c9-4577-b24c-25ff3ce43813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e16ed6-d9c9-4577-b24c-25ff3ce43813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-72066623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfee787-427e-4ef9-a794-aaeda9352a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073eeb8ef90242ff9705bb1a7ba8b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:46Z,use_quota=True,user_id='954637561ca5494bae91fb13c39b827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df88b1e9-1be7-488c-b85e-c09ceb114be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df88b1e9-1be7-488c-b85e-c09ceb114be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f40e50c-169a-4670-84cc-653ccfb0cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f40e50c-169a-4670-84cc-653ccfb0cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfee787-427e-4ef9-a794-aaeda9352a8c', 'volume_name': 'volume-5bfee787-427e-4ef9-a794-aaeda9352a8c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6ca98-99a3-4b07-9ef3-8ca00019c877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6ca98-99a3-4b07-9ef3-8ca00019c877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72903e6e-d645-4dcf-8e13-ee80f66d40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Volume 5bfee787-427e-4ef9-a794-aaeda9352a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfee787-427e-4ef9-a794-aaeda9352a8c', 'volume_size': 1} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:45 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" released by "_copy_volume_from_snapshot" :: held 7.418s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc-882f6f58-6a41-4778-bea5-b2c7ca0946da" released by "_create_volume_from_snapshot" :: held 7.498s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.540s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-72066623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfee787-427e-4ef9-a794-aaeda9352a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073eeb8ef90242ff9705bb1a7ba8b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:46Z,use_quota=True,user_id='954637561ca5494bae91fb13c39b827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Creating volume 5bfee787-427e-4ef9-a794-aaeda9352a8c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:46 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:46 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c 1073741824 Aug 28 16:27:46 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43985890-2f37-4d8e-86c3-2404abe7f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882f6f58-6a41-4778-bea5-b2c7ca0946da', 'volume_size': 1, 'snapshot_id': 'b86419f3-43d4-4471-815b-955a167a47dc'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6b1446-f4c8-4e5f-94dc-d9d0096b201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Volume volume-882f6f58-6a41-4778-bea5-b2c7ca0946da (882f6f58-6a41-4778-bea5-b2c7ca0946da): created successfully Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6b1446-f4c8-4e5f-94dc-d9d0096b201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Flow 'volume_create_manager' (009a19eb-bc0f-4d80-971a-a791ac0eb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5455dd7b-ea6a-4526-abf7-d7345969ae9e tempest-VolumesDeleteCascade-1901408713 None] Created volume successfully. Aug 28 16:27:46 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c 1073741824" returned: 0 in 0.538s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:46 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c Aug 28 16:27:46 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:46 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72903e6e-d645-4dcf-8e13-ee80f66d40ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfee787-427e-4ef9-a794-aaeda9352a8c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26992e94-e030-435b-8f16-91424b25d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Volume volume-5bfee787-427e-4ef9-a794-aaeda9352a8c (5bfee787-427e-4ef9-a794-aaeda9352a8c): created successfully Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26992e94-e030-435b-8f16-91424b25d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Flow 'volume_create_manager' (e0f3e689-0b8a-4fd5-8e61-53a6ab27f88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5d8ce908-659e-446f-a777-01c6541b0164 tempest-VolumesTransfersV355Test-337155639 None] Created volume successfully. Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-941f31b3-e5c9-40ac-85e7-34418bf998a3-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-941f31b3-e5c9-40ac-85e7-34418bf998a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Performing cascade delete. {{(pid=86193) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-b86419f3-43d4-4471-815b-955a167a47dc-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-b86419f3-43d4-4471-815b-955a167a47dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Deleting offline snapshot b86419f3-43d4-4471-815b-955a167a47dc of volume 941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] snapshot_file for this snap is: volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a76b225-0e35-4cb0-92b1-fa8cd899d824]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:47 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:47 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:47 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.421s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-941f31b3-e5c9-40ac-85e7-34418bf998a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef78e9-0ffb-4bd9-8c79-8e9a90dd3843]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:47 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:47 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "cinder-5bfee787-427e-4ef9-a794-aaeda9352a8c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-5bfee787-427e-4ef9-a794-aaeda9352a8c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:48 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.623s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:48 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:48 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "cinder-quobyte-5bfee787-427e-4ef9-a794-aaeda9352a8c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-quobyte-5bfee787-427e-4ef9-a794-aaeda9352a8c" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391f447-14bb-4fcb-bf0e-8e12ba403797]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:48 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c Aug 28 16:27:48 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:48 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:48 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc Aug 28 16:27:48 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:48 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:48 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c Aug 28 16:27:48 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:49 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3.b86419f3-43d4-4471-815b-955a167a47dc" returned: 0 in 0.282s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-b86419f3-43d4-4471-815b-955a167a47dc" released by "_delete_snapshot" :: held 1.905s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" released by "delete_snapshot" :: held 1.933s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:49 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5bfee787-427e-4ef9-a794-aaeda9352a8c" returned: 0 in 0.309s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['cb7f3130-277f-43e1-95bc-2d96d5ed8146', '13b542d5-ec6e-49c9-927b-a6b9005fbf28', '03f4bfac-ad9d-48f5-8139-37f80152698e', 'a6205495-db49-4642-b098-76a4556c76d6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-quobyte-5bfee787-427e-4ef9-a794-aaeda9352a8c" released by "delete_volume" :: held 0.783s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Created reservations ['d23f5133-4f2e-4cbb-8681-c2bcf77c222e', '042b3fdb-3459-4fe3-af44-7fe319233294', 'a4ad56f0-1581-4ab2-a55e-bf67a88ba617', 'd0a05c18-b8bb-4da5-8a96-52d4fbe2ebe9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Delete snapshot completed successfully. Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-b86419f3-43d4-4471-815b-955a167a47dc-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Snapshots deleted, issuing volume delete {{(pid=86193) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8882d2e-9615-4b47-89b7-d758f42cc9c2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:49 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:49 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:49 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:49 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:49 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.377s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Deleted volume successfully. Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0f1575a8-be72-41e3-b0b3-0edc877969d0 tempest-VolumesTransfersV355Test-1133604331 None] Lock "cinder-5bfee787-427e-4ef9-a794-aaeda9352a8c-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:49 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.524s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:49 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3 Aug 28 16:27:49 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:50 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-941f31b3-e5c9-40ac-85e7-34418bf998a3" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-941f31b3-e5c9-40ac-85e7-34418bf998a3" released by "delete_volume" :: held 0.972s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=106,cinder:INSERT=34,cinder:UPDATE=139,cinder:DELETE=11 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['b5f9468f-44f1-4b88-b329-34ae940b091b', '78935935-1a01-4294-a4f3-cb1e495d67ba', 'e7754db0-639b-4316-960c-63b3d89f2bf2', 'f3ccf288-ce8c-4136-adc1-d1f0f3d68397'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:50 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:50 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:50 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Deleted volume successfully. Aug 28 16:27:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-909e606b-a5de-4c22-bd18-3625280a5fcf tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-941f31b3-e5c9-40ac-85e7-34418bf998a3-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-882f6f58-6a41-4778-bea5-b2c7ca0946da-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-882f6f58-6a41-4778-bea5-b2c7ca0946da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[13222161-da1f-419e-8478-d8acf8d4b342]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:27:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:51 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da Aug 28 16:27:51 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:52 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da" returned: 0 in 0.510s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:52 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da Aug 28 16:27:52 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:52 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-882f6f58-6a41-4778-bea5-b2c7ca0946da" returned: 0 in 0.324s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-quobyte-882f6f58-6a41-4778-bea5-b2c7ca0946da" released by "delete_volume" :: held 0.896s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Created reservations ['8210a4d3-85a0-479a-89c3-1f2878d049d7', 'f9c6b43b-ea33-436c-afde-1a0c31018be5', 'a8ce1f26-d31d-428b-9dcb-151ade701673', 'd7671c09-a8f4-425b-ba8c-add85835f8db'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:52 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:27:52 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:53 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:27:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Deleted volume successfully. Aug 28 16:27:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-502865ff-793d-4b3c-ad9b-0a29141381f2 tempest-VolumesDeleteCascade-1901408713 None] Lock "cinder-882f6f58-6a41-4778-bea5-b2c7ca0946da-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (9c5a4fe8-35c2-42ed-ad0f-f94474cd3a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8739d21b-0238-4417-9b53-807770249b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8739d21b-0238-4417-9b53-807770249b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927116251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f79e51-35f0-468c-9c05-0a0babebb8cf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:58Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690c65e3-efe9-404c-b0bb-cd28878db5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690c65e3-efe9-404c-b0bb-cd28878db5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e6ed7-b137-4252-9328-e62ea7dc8c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e6ed7-b137-4252-9328-e62ea7dc8c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f79e51-35f0-468c-9c05-0a0babebb8cf', 'volume_name': 'volume-04f79e51-35f0-468c-9c05-0a0babebb8cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18ddc6-3f38-4596-a825-13172a55f593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18ddc6-3f38-4596-a825-13172a55f593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256afc00-917b-4362-a5f5-5f107c88a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Volume 04f79e51-35f0-468c-9c05-0a0babebb8cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f79e51-35f0-468c-9c05-0a0babebb8cf', 'volume_size': 1} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927116251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f79e51-35f0-468c-9c05-0a0babebb8cf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:27:58Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Creating volume 04f79e51-35f0-468c-9c05-0a0babebb8cf {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:27:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:27:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:58 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf 1073741824 Aug 28 16:27:58 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:59 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf 1073741824" returned: 0 in 0.591s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:27:59 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf Aug 28 16:27:59 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:27:59 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256afc00-917b-4362-a5f5-5f107c88a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f79e51-35f0-468c-9c05-0a0babebb8cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb71e0e8-bafd-421c-bf8d-e364dd6fd814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:27:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Volume volume-04f79e51-35f0-468c-9c05-0a0babebb8cf (04f79e51-35f0-468c-9c05-0a0babebb8cf): created successfully Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb71e0e8-bafd-421c-bf8d-e364dd6fd814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:27:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (9c5a4fe8-35c2-42ed-ad0f-f94474cd3a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:27:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a111a9b1-43ae-4c17-a6d2-5f4b10196bb4 tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (3c925acd-d4ca-4067-af9f-835492afa0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a201e0-f8ac-44c0-a93c-76689de96ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a201e0-f8ac-44c0-a93c-76689de96ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-720692552',display_name='tempest-VolumesGetTest-Volume-1849626116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ead05d-b603-4d80-89cf-8c62fe5792ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:01Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362ae87c-7f10-49be-8b94-8cdd95103f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362ae87c-7f10-49be-8b94-8cdd95103f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ddb1e7-a2a9-4a88-8c82-56919c71e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ddb1e7-a2a9-4a88-8c82-56919c71e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ead05d-b603-4d80-89cf-8c62fe5792ad', 'volume_name': 'volume-41ead05d-b603-4d80-89cf-8c62fe5792ad', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621036d-f9bb-4b49-bb29-68a37cf69e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f621036d-f9bb-4b49-bb29-68a37cf69e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a1cbf6-5e01-4b76-b7e3-23e5c0181419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Volume 41ead05d-b603-4d80-89cf-8c62fe5792ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ead05d-b603-4d80-89cf-8c62fe5792ad', 'volume_size': 1} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-720692552',display_name='tempest-VolumesGetTest-Volume-1849626116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ead05d-b603-4d80-89cf-8c62fe5792ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:01Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Creating volume 41ead05d-b603-4d80-89cf-8c62fe5792ad {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:01 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad 1073741824 Aug 28 16:28:01 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Flow 'volume_create_manager' (b762360d-cbf2-4281-a01e-8e178a836ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff4ddc7-d427-4276-bc9d-3e7ccfe72ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff4ddc7-d427-4276-bc9d-3e7ccfe72ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1495604188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41fea12-4640-4f48-a911-1b3c0efa67aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64c8ade54e40c5858c532f689491a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:02Z,use_quota=True,user_id='dff7b12674ad456ca98e06af81ba69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a31969e-9a13-429d-86ac-9178916c0518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a31969e-9a13-429d-86ac-9178916c0518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa777f5-44ca-4627-ab74-ad45f283c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa777f5-44ca-4627-ab74-ad45f283c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41fea12-4640-4f48-a911-1b3c0efa67aa', 'volume_name': 'volume-e41fea12-4640-4f48-a911-1b3c0efa67aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e570bdc9-4a1d-42a5-a09b-b281da738389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e570bdc9-4a1d-42a5-a09b-b281da738389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673de2b-749a-4349-99d8-2fd92b8ba246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume e41fea12-4640-4f48-a911-1b3c0efa67aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41fea12-4640-4f48-a911-1b3c0efa67aa', 'volume_size': 1} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:02 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad 1073741824" returned: 0 in 0.701s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:02 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad Aug 28 16:28:02 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Flow 'volume_create_manager' (5fa52db1-a4bc-4b87-ad6b-866d4446d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4efcbdb-221d-4fe3-b2f9-6bbd6c83ca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4efcbdb-221d-4fe3-b2f9-6bbd6c83ca07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-73611281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144c952c-ace1-418b-96a8-3bb0426da066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64c8ade54e40c5858c532f689491a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:03Z,use_quota=True,user_id='dff7b12674ad456ca98e06af81ba69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ec7747-3d85-42b1-85f3-e9bd85a6471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ec7747-3d85-42b1-85f3-e9bd85a6471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e1acd-70a8-49fe-9113-a1573c352e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e1acd-70a8-49fe-9113-a1573c352e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144c952c-ace1-418b-96a8-3bb0426da066', 'volume_name': 'volume-144c952c-ace1-418b-96a8-3bb0426da066', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0a7c9a-d0e9-48c1-9793-634cbf081db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0a7c9a-d0e9-48c1-9793-634cbf081db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f0123-5834-42f9-b586-abd505fa4a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume 144c952c-ace1-418b-96a8-3bb0426da066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144c952c-ace1-418b-96a8-3bb0426da066', 'volume_size': 1} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:02 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1495604188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41fea12-4640-4f48-a911-1b3c0efa67aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64c8ade54e40c5858c532f689491a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:02Z,use_quota=True,user_id='dff7b12674ad456ca98e06af81ba69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Creating volume e41fea12-4640-4f48-a911-1b3c0efa67aa {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a1cbf6-5e01-4b76-b7e3-23e5c0181419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ead05d-b603-4d80-89cf-8c62fe5792ad', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa 1073741824 Aug 28 16:28:02 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0e1b44-cfcc-4c46-9727-92f2197eb8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Volume volume-41ead05d-b603-4d80-89cf-8c62fe5792ad (41ead05d-b603-4d80-89cf-8c62fe5792ad): created successfully Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0e1b44-cfcc-4c46-9727-92f2197eb8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (3c925acd-d4ca-4067-af9f-835492afa0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d56baaab-dc1c-4bc7-a638-474437831dbd tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:03 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa 1073741824" returned: 0 in 0.546s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:03 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa Aug 28 16:28:03 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:03 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-73611281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144c952c-ace1-418b-96a8-3bb0426da066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a64c8ade54e40c5858c532f689491a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:03Z,use_quota=True,user_id='dff7b12674ad456ca98e06af81ba69e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Creating volume 144c952c-ace1-418b-96a8-3bb0426da066 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:03 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3673de2b-749a-4349-99d8-2fd92b8ba246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41fea12-4640-4f48-a911-1b3c0efa67aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec81eb6d-87a1-4db7-b9f9-1751f61f9f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:03 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 1073741824 Aug 28 16:28:03 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume volume-e41fea12-4640-4f48-a911-1b3c0efa67aa (e41fea12-4640-4f48-a911-1b3c0efa67aa): created successfully Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec81eb6d-87a1-4db7-b9f9-1751f61f9f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Flow 'volume_create_manager' (b762360d-cbf2-4281-a01e-8e178a836ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-41ead05d-b603-4d80-89cf-8c62fe5792ad-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8a77524e-ed36-41bf-9ece-7f6367f58bad tempest-TestServerVolumeAttachmentScenario-2057173015 None] Created volume successfully. Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "cinder-41ead05d-b603-4d80-89cf-8c62fe5792ad-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-41ead05d-b603-4d80-89cf-8c62fe5792ad" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-41ead05d-b603-4d80-89cf-8c62fe5792ad" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61aa357-56cf-4a95-9794-d3739c990e92]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:04 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad Aug 28 16:28:04 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:04 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 1073741824" returned: 0 in 0.840s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:04 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad" returned: 0 in 0.631s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:04 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad Aug 28 16:28:04 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:04 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 Aug 28 16:28:04 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:05 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-41ead05d-b603-4d80-89cf-8c62fe5792ad" returned: 0 in 0.366s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:05 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-41ead05d-b603-4d80-89cf-8c62fe5792ad" released by "delete_volume" :: held 1.070s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066" returned: 0 in 0.399s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f0123-5834-42f9-b586-abd505fa4a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144c952c-ace1-418b-96a8-3bb0426da066', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec104af-7d21-4eb2-bcd5-f4836e4de324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Volume volume-144c952c-ace1-418b-96a8-3bb0426da066 (144c952c-ace1-418b-96a8-3bb0426da066): created successfully Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec104af-7d21-4eb2-bcd5-f4836e4de324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Flow 'volume_create_manager' (5fa52db1-a4bc-4b87-ad6b-866d4446d458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-846c14f0-38ec-4ac8-9ee9-5e60b8bb1389 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Created volume successfully. Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Created reservations ['0d15b68f-0802-4fba-9a6e-bcb8dd079aec', '2d2bf514-cbf3-4ce5-b6a5-c72e85d1fd07', 'fc6e3496-a6e3-455a-a77e-c2e340e137d1', '8d02e895-41ea-4cc4-bf6d-54cc79c287c0'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:05 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:05 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:05 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e6e85bec-b176-46c8-805a-903f18142c4b tempest-VolumesGetTest-732250977 None] Lock "cinder-41ead05d-b603-4d80-89cf-8c62fe5792ad-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-04f79e51-35f0-468c-9c05-0a0babebb8cf-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "cinder-04f79e51-35f0-468c-9c05-0a0babebb8cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-04f79e51-35f0-468c-9c05-0a0babebb8cf" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-04f79e51-35f0-468c-9c05-0a0babebb8cf" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d99a8a-f017-4c47-a2b6-53284d3587c2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:06 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf Aug 28 16:28:06 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:07 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf" returned: 0 in 0.468s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:07 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf Aug 28 16:28:07 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:07 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-04f79e51-35f0-468c-9c05-0a0babebb8cf" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-04f79e51-35f0-468c-9c05-0a0babebb8cf" released by "delete_volume" :: held 0.816s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Created reservations ['003ca43f-2f77-405e-a7a9-451ee3acc651', '23d3e229-ab22-4c84-84cb-410f3ebd193c', '17950a79-650d-490e-a61f-ef855ecd39f7', '9c96955f-64eb-46e4-8e40-42c085c89381'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:07 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:07 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:07 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ea5adaee-1b14-43b5-9e24-3c8b32326ac5 tempest-VolumesGetTest-732250977 None] Lock "cinder-04f79e51-35f0-468c-9c05-0a0babebb8cf-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (3b943a17-6967-4c19-8861-7478a5abb3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f77972-e858-44b5-875f-fbcff9cf34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f77972-e858-44b5-875f-fbcff9cf34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1890803177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b622981-cf79-4624-8c4e-fa6d21ff237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:08Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1efb3d-1d91-4efc-950b-a7a4cf71b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1efb3d-1d91-4efc-950b-a7a4cf71b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d10a62-c012-4dc4-affe-3357abe19f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d10a62-c012-4dc4-affe-3357abe19f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b622981-cf79-4624-8c4e-fa6d21ff237e', 'volume_name': 'volume-3b622981-cf79-4624-8c4e-fa6d21ff237e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03dde7c-d022-44ca-b22c-b793513bdc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03dde7c-d022-44ca-b22c-b793513bdc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68947e-7bbe-4548-8d2d-38f8c5dfc5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Volume 3b622981-cf79-4624-8c4e-fa6d21ff237e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b622981-cf79-4624-8c4e-fa6d21ff237e', 'volume_size': 1} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1890803177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b622981-cf79-4624-8c4e-fa6d21ff237e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:08Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Creating volume 3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:08 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:08 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e 1073741824 Aug 28 16:28:08 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:09 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e 1073741824" returned: 0 in 0.832s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:09 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:09 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:09 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c68947e-7bbe-4548-8d2d-38f8c5dfc5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b622981-cf79-4624-8c4e-fa6d21ff237e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97dcb6-2c6f-4279-94bf-1150cfe6a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:09 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Volume volume-3b622981-cf79-4624-8c4e-fa6d21ff237e (3b622981-cf79-4624-8c4e-fa6d21ff237e): created successfully Aug 28 16:28:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97dcb6-2c6f-4279-94bf-1150cfe6a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (3b943a17-6967-4c19-8861-7478a5abb3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b71c179a-0e2e-4481-9450-933e01cd7824 tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (b22bc55c-eff0-4c53-91b0-6b3dafd0f0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3a814a-242f-4b87-a0c4-518cffd1f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3a814a-242f-4b87-a0c4-518cffd1f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1975584987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7781d7d9-31be-48e5-9549-d97fc2336e39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3b622981-cf79-4624-8c4e-fa6d21ff237e,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:11Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d0d681-d758-4e52-a5f1-eda14d65d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d0d681-d758-4e52-a5f1-eda14d65d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20292d47-1878-44b6-91a9-d1af454c18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20292d47-1878-44b6-91a9-d1af454c18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7781d7d9-31be-48e5-9549-d97fc2336e39', 'volume_name': 'volume-7781d7d9-31be-48e5-9549-d97fc2336e39', 'volume_size': 1, 'source_volid': '3b622981-cf79-4624-8c4e-fa6d21ff237e', 'source_volstatus': 'available'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ad0ced-555b-45ed-9c59-b1fd333eb0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ad0ced-555b-45ed-9c59-b1fd333eb0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff308c-e4d8-48b7-a15b-c055918180db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Volume 7781d7d9-31be-48e5-9549-d97fc2336e39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7781d7d9-31be-48e5-9549-d97fc2336e39', 'volume_size': 1, 'source_volid': '3b622981-cf79-4624-8c4e-fa6d21ff237e', 'source_volstatus': 'available'} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Cloning volume 3b622981-cf79-4624-8c4e-fa6d21ff237e to volume 7781d7d9-31be-48e5-9549-d97fc2336e39 Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Flow 'volume_create_manager' (6905aa7c-3c50-48f5-93de-f0d936491c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48106c-61ca-4b20-8079-769d36290dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48106c-61ca-4b20-8079-769d36290dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191940340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bccc63e98e48d3a92d5bc7abdc831d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:12Z,use_quota=True,user_id='9e9d6c23522545e99bea84a17c6efa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d3bf2e-7b09-4360-9096-b656fde4f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d3bf2e-7b09-4360-9096-b656fde4f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee5ce90-e918-4e1d-82f1-b9792a30b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee5ce90-e918-4e1d-82f1-b9792a30b617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca', 'volume_name': 'volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e957c5-cc67-4334-a283-806b532ab5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e957c5-cc67-4334-a283-806b532ab5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5929cdb1-daad-4e8b-a84f-5c7f13a712b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca', 'volume_size': 1} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Creating offline snapshot 96ff3f77-5055-4beb-bbb1-dccaf856d6f0 of volume 3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b61874-760d-4b42-8c3f-c05ecaaf43e4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:12 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:12 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:12 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.556s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:12 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 1G Aug 28 16:28:12 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:12 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 1G" returned: 0 in 0.479s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b622981-cf79-4624-8c4e-fa6d21ff237e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:12 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b622981-cf79-4624-8c4e-fa6d21ff237e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:12 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:13 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b622981-cf79-4624-8c4e-fa6d21ff237e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.377s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:13 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 is being set with open permissions: ugo+rw Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:13 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:13 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:13 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:13 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info Aug 28 16:28:13 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:13 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:13 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info is being set with open permissions: ugo+rw Aug 28 16:28:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:14 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info Aug 28 16:28:14 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:14 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.info" returned: 0 in 0.467s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] snapshot: 96ff3f77-5055-4beb-bbb1-dccaf856d6f0, volume: 7781d7d9-31be-48e5-9549-d97fc2336e39, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6fd25-dd8b-44eb-9901-12614fbf7d10]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:14 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:14 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:15 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.708s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b622981-cf79-4624-8c4e-fa6d21ff237e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea5d772-ddc6-4410-a2e3-fcae21bfde5f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:15 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:15 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:15 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:28:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:15 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 Aug 28 16:28:15 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:23 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39" returned: 0 in 7.399s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:28:23 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Converted 1024.00 MB image at 138.38 MB/s Aug 28 16:28:23 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 is being set with open permissions: ugo+rw Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:23 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 Aug 28 16:28:23 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:23 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" released by "_copy_volume_from_snapshot" :: held 8.970s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-96ff3f77-5055-4beb-bbb1-dccaf856d6f0" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-96ff3f77-5055-4beb-bbb1-dccaf856d6f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Deleting offline snapshot 96ff3f77-5055-4beb-bbb1-dccaf856d6f0 of volume 3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] snapshot_file for this snap is: volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f374962d-0a99-485c-8498-9c7ae852847b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:INSERT=13,cinder:UPDATE=40,cinder:SELECT=36,cinder:DELETE=2 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:28:23 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:23 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:23 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b622981-cf79-4624-8c4e-fa6d21ff237e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6e353-430e-4f03-ae96-ef2422cccbfc]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:24 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:24 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:24 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.563s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:24 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:24 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:24 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:24 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0 Aug 28 16:28:24 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:25 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e.96ff3f77-5055-4beb-bbb1-dccaf856d6f0" returned: 0 in 0.248s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-96ff3f77-5055-4beb-bbb1-dccaf856d6f0" released by "_delete_snapshot" :: held 1.703s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.552s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.427s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-191940340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bccc63e98e48d3a92d5bc7abdc831d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:12Z,use_quota=True,user_id='9e9d6c23522545e99bea84a17c6efa8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Creating volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:25 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:25 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca 1073741824 Aug 28 16:28:25 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff308c-e4d8-48b7-a15b-c055918180db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7781d7d9-31be-48e5-9549-d97fc2336e39', 'volume_size': 1, 'source_volid': '3b622981-cf79-4624-8c4e-fa6d21ff237e', 'source_volstatus': 'available'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835cccac-0ecd-4b3f-a055-1c313ffe9045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Volume volume-7781d7d9-31be-48e5-9549-d97fc2336e39 (7781d7d9-31be-48e5-9549-d97fc2336e39): created successfully Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835cccac-0ecd-4b3f-a055-1c313ffe9045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (b22bc55c-eff0-4c53-91b0-6b3dafd0f0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-20ff4128-4222-4ddd-95c0-451a9b59838e tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:25 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca 1073741824" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:25 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:28:25 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:26 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5929cdb1-daad-4e8b-a84f-5c7f13a712b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2070f2f9-4536-4fb7-8a51-435f08efb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Volume volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca (4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca): created successfully Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2070f2f9-4536-4fb7-8a51-435f08efb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Flow 'volume_create_manager' (6905aa7c-3c50-48f5-93de-f0d936491c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a3e45192-a097-4cb3-82be-96ccfeb2ae1b tempest-VolumesActionsTest-435368204 None] Created volume successfully. Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (1d34e855-85fb-46b0-b249-a12054179012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e05bd-c7e5-4403-b49d-09309c6adc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513e05bd-c7e5-4403-b49d-09309c6adc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741879783',display_name='tempest-VolumesGetTest-Volume-1516835715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432f9bf7-4b63-43e0-a83b-9665d954a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:27Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4725b8a-217e-45c1-a2ca-386ede108e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4725b8a-217e-45c1-a2ca-386ede108e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdb7937-95e9-4ca9-8072-3e82b4d05167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdb7937-95e9-4ca9-8072-3e82b4d05167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '432f9bf7-4b63-43e0-a83b-9665d954a327', 'volume_name': 'volume-432f9bf7-4b63-43e0-a83b-9665d954a327', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667196a7-8f08-4814-a43c-4f5fe1175b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667196a7-8f08-4814-a43c-4f5fe1175b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f975121-7a38-4720-a59b-2c473cc83826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Volume 432f9bf7-4b63-43e0-a83b-9665d954a327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-432f9bf7-4b63-43e0-a83b-9665d954a327', 'volume_size': 1} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741879783',display_name='tempest-VolumesGetTest-Volume-1516835715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432f9bf7-4b63-43e0-a83b-9665d954a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:27Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Creating volume 432f9bf7-4b63-43e0-a83b-9665d954a327 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:26 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:26 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 1073741824 Aug 28 16:28:26 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:27 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 1073741824" returned: 0 in 0.491s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=89,cinder:INSERT=28,cinder:UPDATE=125,cinder:DELETE=13 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:27 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 Aug 28 16:28:27 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:27 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327" returned: 0 in 0.314s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f975121-7a38-4720-a59b-2c473cc83826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-432f9bf7-4b63-43e0-a83b-9665d954a327', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e20e486-d410-488f-996c-f8723f374968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Volume volume-432f9bf7-4b63-43e0-a83b-9665d954a327 (432f9bf7-4b63-43e0-a83b-9665d954a327): created successfully Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e20e486-d410-488f-996c-f8723f374968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (1d34e855-85fb-46b0-b249-a12054179012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b93798b1-7201-4a97-9021-cb3599ecc516 tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-432f9bf7-4b63-43e0-a83b-9665d954a327-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "cinder-432f9bf7-4b63-43e0-a83b-9665d954a327-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-432f9bf7-4b63-43e0-a83b-9665d954a327" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-432f9bf7-4b63-43e0-a83b-9665d954a327" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af52c39-6627-44bd-b9e7-82fdcabd320c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:29 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 Aug 28 16:28:29 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:29 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327" returned: 0 in 0.505s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:29 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327 Aug 28 16:28:29 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:30 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-432f9bf7-4b63-43e0-a83b-9665d954a327" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-432f9bf7-4b63-43e0-a83b-9665d954a327" released by "delete_volume" :: held 0.956s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Created reservations ['57ebf6e8-d793-4992-a5de-69af0de9790b', '3e0203d7-07e0-4a8c-9143-ffdf47b3a1f9', '27954c5a-183e-4a40-8e51-ce0949f4a80d', '63a57914-9cd4-4443-b184-504fbd851a0f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:30 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:30 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:30 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.268s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a19c9bac-2db3-48df-b7db-478c35e0ef9d tempest-VolumesGetTest-732250977 None] Lock "cinder-432f9bf7-4b63-43e0-a83b-9665d954a327-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:31 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:31 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-7781d7d9-31be-48e5-9549-d97fc2336e39-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "cinder-7781d7d9-31be-48e5-9549-d97fc2336e39-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01ebce-26d6-4ab3-8bfa-89e950f4ff39]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:31 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.392s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:28:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:28:31 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 Aug 28 16:28:31 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:32 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39" returned: 0 in 0.570s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:32 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39 Aug 28 16:28:32 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:32 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-7781d7d9-31be-48e5-9549-d97fc2336e39" returned: 0 in 0.446s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-7781d7d9-31be-48e5-9549-d97fc2336e39" released by "delete_volume" :: held 1.093s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:32 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Created reservations ['617aae33-9654-4172-b192-df0859c8b4f3', '5ca17dda-784e-448b-81d0-8a4761ce3b3a', '9c03486c-116e-43ed-8cee-e30f326bcdf6', '9c6cc780-a5e4-4522-86a7-83e032030e16'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:33 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:33 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:33 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.463s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-26a0768a-09f3-4a92-ac47-48766e067dd3 tempest-VolumesGetTest-732250977 None] Lock "cinder-7781d7d9-31be-48e5-9549-d97fc2336e39-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-3b622981-cf79-4624-8c4e-fa6d21ff237e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "cinder-3b622981-cf79-4624-8c4e-fa6d21ff237e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-3b622981-cf79-4624-8c4e-fa6d21ff237e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-3b622981-cf79-4624-8c4e-fa6d21ff237e" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf8bb0-1d3f-41fd-bcf1-f2ebc81c453b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:34 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:34 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b9c5ebb9-f50e-47f3-8c05-fba90579178b tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" by "attach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b9c5ebb9-f50e-47f3-8c05-fba90579178b tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" acquired by "attach_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:34 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.543s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:34 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e Aug 28 16:28:34 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b9c5ebb9-f50e-47f3-8c05-fba90579178b tempest-VolumesActionsTest-435368204 None] Attaching volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca to instance 784d6273-f9a9-4b68-bfc7-41cd7e713669 at mountpoint /dev/vdb on host None. Aug 28 16:28:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b9c5ebb9-f50e-47f3-8c05-fba90579178b tempest-VolumesActionsTest-435368204 None] Attach volume completed successfully. Aug 28 16:28:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b9c5ebb9-f50e-47f3-8c05-fba90579178b tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" released by "attach_volume" :: held 0.158s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1c39303-d88a-4565-a149-d59b0d81c2a5 tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" by "detach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1c39303-d88a-4565-a149-d59b0d81c2a5 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a1c39303-d88a-4565-a149-d59b0d81c2a5 tempest-VolumesActionsTest-435368204 None] Detaching volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca from instance 784d6273-f9a9-4b68-bfc7-41cd7e713669. Aug 28 16:28:35 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b622981-cf79-4624-8c4e-fa6d21ff237e" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-3b622981-cf79-4624-8c4e-fa6d21ff237e" released by "delete_volume" :: held 1.056s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a1c39303-d88a-4565-a149-d59b0d81c2a5 tempest-VolumesActionsTest-435368204 None] Detach volume completed successfully. Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a1c39303-d88a-4565-a149-d59b0d81c2a5 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Created reservations ['f7a284ec-dc97-4bd2-83d0-db6aea6fa4af', 'a8b03db9-71b1-40d1-b061-cb303e2fd9f8', '189529d0-4b2f-45e5-90ed-a4006dc23a21', 'fb0942f8-8a12-41b2-ae20-98a28dc4bb66'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:35 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:35 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:35 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.459s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ae36045-8f27-4d2d-9da1-3264c1d12fbe tempest-VolumesGetTest-732250977 None] Lock "cinder-3b622981-cf79-4624-8c4e-fa6d21ff237e-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (699d5862-a94e-4659-90cd-8c2573c4483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea61d247-1f21-480d-926f-d69e316d2fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea61d247-1f21-480d-926f-d69e316d2fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-379479930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660a0670-694a-46f3-8bc6-0639618eab4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:37Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b14fde-b5f2-4136-bdf1-601a3c4d7670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b14fde-b5f2-4136-bdf1-601a3c4d7670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c3a191-044e-4297-af10-0d11d54321ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:37 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c3a191-044e-4297-af10-0d11d54321ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '660a0670-694a-46f3-8bc6-0639618eab4e', 'volume_name': 'volume-660a0670-694a-46f3-8bc6-0639618eab4e', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34376ff1-cc80-478b-b5b5-e9d03ec6d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34376ff1-cc80-478b-b5b5-e9d03ec6d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61988d38-96da-4602-b444-c67d5193710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:38 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Volume 660a0670-694a-46f3-8bc6-0639618eab4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-660a0670-694a-46f3-8bc6-0639618eab4e', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Trying to clone 660a0670-694a-46f3-8bc6-0639618eab4e from image bfd32705-759a-4eec-aec1-8d911107c463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:28:38 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Image download 20.69 MB at 20.69 MB/s Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0387764-099d-4ae7-99de-0e8b6d990306]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:38 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD Aug 28 16:28:38 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:39 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 is fetched for user e8afbea68c6d4769969530a9d5ba856e. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e157a91f-a89d-4ce8-ad77-6354acc6b0d8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:39 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD Aug 28 16:28:39 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:39 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-379479930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660a0670-694a-46f3-8bc6-0639618eab4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:37Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Creating volume 660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:39 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:39 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1073741824 Aug 28 16:28:39 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:40 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1073741824" returned: 0 in 0.539s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:40 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e Aug 28 16:28:40 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:40 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e" returned: 0 in 0.320s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Attempting download of bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 660a0670-694a-46f3-8bc6-0639618eab4e. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[01693b1b-e79f-42f9-996a-275ae0dacf0f]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:40 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g Aug 28 16:28:40 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:40 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:41 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g Aug 28 16:28:41 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:41 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g" returned: 1 in 0.418s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_jbxkz97g' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[309cb86b-737b-4a39-a650-d5b2a0b6c2a0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:41 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD Aug 28 16:28:41 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:41 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] bfd32705-759a-4eec-aec1-8d911107c463 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:28:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:41 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e Aug 28 16:28:41 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:44 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e" returned: 0 in 2.516s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463__0wopbemdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:28:44 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Converted 112.00 MB image at 44.48 MB/s Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-992b005f-becf-4a80-8dee-8e4a3b3959e1 req-f2f56d99-4629-4ef9-af9b-9580dfb9b8bc tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-992b005f-becf-4a80-8dee-8e4a3b3959e1 req-f2f56d99-4629-4ef9-af9b-9580dfb9b8bc tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:44 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1G Aug 28 16:28:44 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-992b005f-becf-4a80-8dee-8e4a3b3959e1 req-f2f56d99-4629-4ef9-af9b-9580dfb9b8bc tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-992b005f-becf-4a80-8dee-8e4a3b3959e1 req-f2f56d99-4629-4ef9-af9b-9580dfb9b8bc tempest-TestServerVolumeAttachmentScenario-2057173015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-e41fea12-4640-4f48-a911-1b3c0efa67aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11d6e7c1-d396-46a0-a3fa-2fd3808fbf99', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:28:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-992b005f-becf-4a80-8dee-8e4a3b3959e1 req-f2f56d99-4629-4ef9-af9b-9580dfb9b8bc tempest-TestServerVolumeAttachmentScenario-2057173015 None] attachment_update completed successfully. Aug 28 16:28:44 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e 1G" returned: 0 in 0.675s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Downloaded image bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 660a0670-694a-46f3-8bc6-0639618eab4e successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 for user e8afbea68c6d4769969530a9d5ba856e is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Marking volume 660a0670-694a-46f3-8bc6-0639618eab4e as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Copying metadata from image bfd32705-759a-4eec-aec1-8d911107c463 to 660a0670-694a-46f3-8bc6-0639618eab4e. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Creating volume glance metadata for volume 660a0670-694a-46f3-8bc6-0639618eab4e backed by image bfd32705-759a-4eec-aec1-8d911107c463 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61988d38-96da-4602-b444-c67d5193710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660a0670-694a-46f3-8bc6-0639618eab4e', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9070b3f3-6b29-4137-a3ee-608be96c60c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Volume volume-660a0670-694a-46f3-8bc6-0639618eab4e (660a0670-694a-46f3-8bc6-0639618eab4e): created successfully Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9070b3f3-6b29-4137-a3ee-608be96c60c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (699d5862-a94e-4659-90cd-8c2573c4483e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1936ed5d-d256-43e6-9236-9529c95f956b tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (8ebe04c8-62a3-4ea5-ab0f-16c0a6098395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef7c31c-c61c-4d8e-bef5-5e08c873f0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef7c31c-c61c-4d8e-bef5-5e08c873f0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446248969',display_name='tempest-VolumesGetTest-Volume-1361982050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d89fe-373f-414e-afeb-f37781565d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:47Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e417cd-5cc3-48d9-851a-e9ca03a2ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e417cd-5cc3-48d9-851a-e9ca03a2ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a74b622-2f60-4d82-bc76-bba13aa0cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a74b622-2f60-4d82-bc76-bba13aa0cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5d89fe-373f-414e-afeb-f37781565d2b', 'volume_name': 'volume-dc5d89fe-373f-414e-afeb-f37781565d2b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1c83d3-6875-47db-a7de-d3f0fa9fb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1c83d3-6875-47db-a7de-d3f0fa9fb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1777f9e-d445-4714-854e-7ad3e79e4eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:47 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Volume dc5d89fe-373f-414e-afeb-f37781565d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5d89fe-373f-414e-afeb-f37781565d2b', 'volume_size': 1} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1446248969',display_name='tempest-VolumesGetTest-Volume-1361982050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d89fe-373f-414e-afeb-f37781565d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7734789d47ad48e382f389a26f99807f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:28:47Z,use_quota=True,user_id='e8afbea68c6d4769969530a9d5ba856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Creating volume dc5d89fe-373f-414e-afeb-f37781565d2b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:28:47 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:47 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b 1073741824 Aug 28 16:28:47 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:47 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b 1073741824" returned: 0 in 0.536s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:47 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b Aug 28 16:28:47 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-332ee9cc-9585-44a0-b4a7-8a2ef6e3be9e tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" by "attach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-332ee9cc-9585-44a0-b4a7-8a2ef6e3be9e tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" acquired by "attach_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-332ee9cc-9585-44a0-b4a7-8a2ef6e3be9e tempest-VolumesActionsTest-435368204 None] Attaching volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca to instance 36b7827f-b229-4a01-8e2c-f4acf30048a7 at mountpoint /dev/vdb on host None. Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-332ee9cc-9585-44a0-b4a7-8a2ef6e3be9e tempest-VolumesActionsTest-435368204 None] Attach volume completed successfully. Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-332ee9cc-9585-44a0-b4a7-8a2ef6e3be9e tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" released by "attach_volume" :: held 0.143s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:48 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b" returned: 0 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1777f9e-d445-4714-854e-7ad3e79e4eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5d89fe-373f-414e-afeb-f37781565d2b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08569532-8603-4c30-942f-e85fbdf52d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Volume volume-dc5d89fe-373f-414e-afeb-f37781565d2b (dc5d89fe-373f-414e-afeb-f37781565d2b): created successfully Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08569532-8603-4c30-942f-e85fbdf52d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Flow 'volume_create_manager' (8ebe04c8-62a3-4ea5-ab0f-16c0a6098395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5b435d92-f42c-4a98-85a6-d761bb7b3aaa tempest-VolumesGetTest-732250977 None] Created volume successfully. Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f45620e4-c07b-46ba-b4c6-1823522b7e04 tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" by "detach_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f45620e4-c07b-46ba-b4c6-1823522b7e04 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f45620e4-c07b-46ba-b4c6-1823522b7e04 tempest-VolumesActionsTest-435368204 None] Detaching volume 4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca from instance 36b7827f-b229-4a01-8e2c-f4acf30048a7. Aug 28 16:28:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f45620e4-c07b-46ba-b4c6-1823522b7e04 tempest-VolumesActionsTest-435368204 None] Detach volume completed successfully. Aug 28 16:28:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f45620e4-c07b-46ba-b4c6-1823522b7e04 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-dc5d89fe-373f-414e-afeb-f37781565d2b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "cinder-dc5d89fe-373f-414e-afeb-f37781565d2b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-dc5d89fe-373f-414e-afeb-f37781565d2b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-dc5d89fe-373f-414e-afeb-f37781565d2b" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda9af6-ed25-44d0-9965-e47a00febd8f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:50 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b Aug 28 16:28:50 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-192eb53c-a990-48bd-9dad-bc64dd6b7303 req-b5e4cd1f-e9e2-43d0-b71f-61549058e7fd tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-192eb53c-a990-48bd-9dad-bc64dd6b7303 req-b5e4cd1f-e9e2-43d0-b71f-61549058e7fd tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-192eb53c-a990-48bd-9dad-bc64dd6b7303 req-b5e4cd1f-e9e2-43d0-b71f-61549058e7fd tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-192eb53c-a990-48bd-9dad-bc64dd6b7303 req-b5e4cd1f-e9e2-43d0-b71f-61549058e7fd tempest-TestServerVolumeAttachmentScenario-2057173015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-144c952c-ace1-418b-96a8-3bb0426da066', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c15632d-8f81-4825-8549-a9091c568c70', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:28:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-192eb53c-a990-48bd-9dad-bc64dd6b7303 req-b5e4cd1f-e9e2-43d0-b71f-61549058e7fd tempest-TestServerVolumeAttachmentScenario-2057173015 None] attachment_update completed successfully. Aug 28 16:28:50 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b" returned: 0 in 0.715s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:50 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b Aug 28 16:28:50 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:50 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dc5d89fe-373f-414e-afeb-f37781565d2b" returned: 0 in 0.427s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-dc5d89fe-373f-414e-afeb-f37781565d2b" released by "delete_volume" :: held 1.223s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Created reservations ['ed505356-a6cd-498e-9655-384d3cb40f20', '8a15cbb6-4c7b-4659-960d-93cec56da2fa', 'e8151059-59b1-4501-8628-b244137375c4', '398759a2-d3d6-4b7d-95c2-15bee9853543'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:51 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:51 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:51 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ced31f2a-3091-4a15-8f72-255f06289e08 tempest-VolumesGetTest-732250977 None] Lock "cinder-dc5d89fe-373f-414e-afeb-f37781565d2b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-660a0670-694a-46f3-8bc6-0639618eab4e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "cinder-660a0670-694a-46f3-8bc6-0639618eab4e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Acquiring lock "cinder-quobyte-660a0670-694a-46f3-8bc6-0639618eab4e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-660a0670-694a-46f3-8bc6-0639618eab4e" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4c258-eafa-4980-abeb-b094c828b96b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:52 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e Aug 28 16:28:52 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:52 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e" returned: 0 in 0.453s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:52 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e Aug 28 16:28:52 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-5f752484-0f07-40e5-b370-cff24ee4a3c2 req-cf58be87-1d87-44bf-b424-c2eb83c3560c tempest-TestServerVolumeAttachmentScenario-2057173015 None] Terminate volume connection completed successfully. Aug 28 16:28:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-5f752484-0f07-40e5-b370-cff24ee4a3c2 req-cf58be87-1d87-44bf-b424-c2eb83c3560c tempest-TestServerVolumeAttachmentScenario-2057173015 None] Deleting attachment 9c15632d-8f81-4825-8549-a9091c568c70. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:28:53 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-660a0670-694a-46f3-8bc6-0639618eab4e" returned: 0 in 0.272s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "cinder-quobyte-660a0670-694a-46f3-8bc6-0639618eab4e" released by "delete_volume" :: held 0.795s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Created reservations ['74b5a52f-cbd2-4fd8-b8ee-e44d03df0683', '44417a18-b10a-49dd-93bd-d36df72232d4', 'a1502b71-213b-4385-a1e6-c032aacc68cc', '36467f17-2b3f-4e16-a659-249eb4c74fae'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:53 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:28:53 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:53 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.318s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:28:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Deleted volume successfully. Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ad119043-be30-4687-b023-e0d0c5b2cc74 tempest-VolumesGetTest-732250977 None] Lock "cinder-660a0670-694a-46f3-8bc6-0639618eab4e-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312da6c-d128-477b-857e-a7c93ee2de55]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:53 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:28:53 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:54 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.431s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94ae905-b569-4173-84e7-82c357e63c09]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:54 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:28:54 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:28:54 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 28 16:28:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-686d35d6-efb4-4b22-8433-e9ddf0ef5dc9 req-c7b19624-f5de-457a-ac29-3f48a33bc92e tempest-TestServerVolumeAttachmentScenario-2057173015 None] Terminate volume connection completed successfully. Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-686d35d6-efb4-4b22-8433-e9ddf0ef5dc9 req-c7b19624-f5de-457a-ac29-3f48a33bc92e tempest-TestServerVolumeAttachmentScenario-2057173015 None] Deleting attachment 11d6e7c1-d396-46a0-a3fa-2fd3808fbf99. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.572s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:28:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.977a1c3e-fbde-4cf9-8110-38972af83bfbu5t_48k7.img {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:28:54 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.977a1c3e-fbde-4cf9-8110-38972af83bfbu5t_48k7.img Aug 28 16:28:54 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:01 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.977a1c3e-fbde-4cf9-8110-38972af83bfbu5t_48k7.img" returned: 0 in 6.363s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a9053-79fe-4a63-a8a6-7840c82d7b64]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:01 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:01 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:01 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.666s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.977a1c3e-fbde-4cf9-8110-38972af83bfbu5t_48k7.img {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:29:01 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Converted 1024.00 MB image at 160.88 MB/s Aug 28 16:29:01 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] 977a1c3e-fbde-4cf9-8110-38972af83bfb was raw, no need to convert to raw {{(pid=86193) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "cinder-144c952c-ace1-418b-96a8-3bb0426da066-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-144c952c-ace1-418b-96a8-3bb0426da066-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "cinder-quobyte-144c952c-ace1-418b-96a8-3bb0426da066" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-quobyte-144c952c-ace1-418b-96a8-3bb0426da066" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f8f432-78db-48ca-88ad-d52a49d91387]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:03 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 Aug 28 16:29:03 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:04 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (6b297dff-df85-45e5-9e0e-73873003cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879fb966-98ed-4d43-b63b-ea45b4ea5d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066" returned: 0 in 0.596s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879fb966-98ed-4d43-b63b-ea45b4ea5d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2085520628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe18c84-c851-4dfe-a4e6-53a0a6791efd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:04Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:04 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066 Aug 28 16:29:04 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42660132-ef97-4159-8187-9beae5b967f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42660132-ef97-4159-8187-9beae5b967f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a11a46-8a9f-4653-848a-a8c53bb4cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a11a46-8a9f-4653-848a-a8c53bb4cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe18c84-c851-4dfe-a4e6-53a0a6791efd', 'volume_name': 'volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5767db-80f0-49a9-a39e-d8d76099eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5767db-80f0-49a9-a39e-d8d76099eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b24df2-44b9-4ded-b49c-c02469e53bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Volume 8fe18c84-c851-4dfe-a4e6-53a0a6791efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd', 'volume_size': 1} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:04 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-144c952c-ace1-418b-96a8-3bb0426da066" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-quobyte-144c952c-ace1-418b-96a8-3bb0426da066" released by "delete_volume" :: held 0.957s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Created reservations ['c597ab7c-4817-4f6e-88f2-d6a61bbb4b6f', '502b2688-3696-40f3-ba2d-d886879467b2', '0b5e6bfa-5062-44b7-b0f4-01a071863abc', '6d9d5da8-228c-44aa-a877-f1ebedf9213e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:04 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:04 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:05 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.311s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Deleted volume successfully. Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e13d6d98-e6ca-4c49-85d0-f06af7ee3ad7 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-144c952c-ace1-418b-96a8-3bb0426da066-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "cinder-e41fea12-4640-4f48-a911-1b3c0efa67aa-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-e41fea12-4640-4f48-a911-1b3c0efa67aa-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "cinder-quobyte-e41fea12-4640-4f48-a911-1b3c0efa67aa" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-quobyte-e41fea12-4640-4f48-a911-1b3c0efa67aa" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe12a7-7cef-477e-ac2f-ee78d9f2a585]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:06 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa Aug 28 16:29:06 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:06 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa" returned: 0 in 0.469s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:06 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa Aug 28 16:29:06 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:06 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41fea12-4640-4f48-a911-1b3c0efa67aa" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-quobyte-e41fea12-4640-4f48-a911-1b3c0efa67aa" released by "delete_volume" :: held 0.828s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Created reservations ['174d7da4-abb1-4d19-a8fd-92d5ab91f1eb', '2ab221a1-067a-4608-a20c-86739d20901d', 'fe2fbad4-9b16-4f83-8b13-5a96b92d7177', '3f65efe0-2f71-49a7-a117-ba234bbd6997'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:07 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:07 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:07 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.470s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:07 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Deleted volume successfully. Aug 28 16:29:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dd6ef8df-68d3-4d3d-b6e5-2a0a3749a9e5 tempest-TestServerVolumeAttachmentScenario-2057173015 None] Lock "cinder-e41fea12-4640-4f48-a911-1b3c0efa67aa-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:16 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=85,cinder:SELECT=79,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:29:17 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=75,cinder:DELETE=5,cinder:SELECT=79,cinder:INSERT=24 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (bf53c124-d0bf-4087-8480-364bac0315ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc360bc-26d8-404b-b60d-50dda6c2f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc360bc-26d8-404b-b60d-50dda6c2f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305982786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09149a-d59c-42d4-a579-bcc057dde4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:22Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de234a66-780c-4c89-9350-2c2464267637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de234a66-780c-4c89-9350-2c2464267637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9dddd4-184e-449e-9d74-2d64812ce118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9dddd4-184e-449e-9d74-2d64812ce118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c09149a-d59c-42d4-a579-bcc057dde4c2', 'volume_name': 'volume-6c09149a-d59c-42d4-a579-bcc057dde4c2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6febfa-999a-4c7b-98c0-6f0dcdde364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6febfa-999a-4c7b-98c0-6f0dcdde364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b1aa87-4668-413e-96d9-8c9fbaadb747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Volume 6c09149a-d59c-42d4-a579-bcc057dde4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c09149a-d59c-42d4-a579-bcc057dde4c2', 'volume_size': 1} Aug 28 16:29:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (88a36b30-b4ae-4a87-b5b3-d272b11be0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df782e36-460f-4a2c-b45d-8b4ee99403ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df782e36-460f-4a2c-b45d-8b4ee99403ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326151479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752a24a3-9d2c-4a26-9135-7fec9d868e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:22Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32caca-4fb1-4b06-9a51-d73ad469f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32caca-4fb1-4b06-9a51-d73ad469f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e99bdb-b764-44f6-8672-d8a2fe737887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e99bdb-b764-44f6-8672-d8a2fe737887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752a24a3-9d2c-4a26-9135-7fec9d868e2c', 'volume_name': 'volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e3c94a-a010-4351-86d0-8bd39e96bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e3c94a-a010-4351-86d0-8bd39e96bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7653e1c3-7ab1-4d27-b537-f05bf8fbf0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Volume 752a24a3-9d2c-4a26-9135-7fec9d868e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c', 'volume_size': 1} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (59a235fb-6ad5-4804-8e48-5859ada7b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2045af27-fe19-4170-ba72-32bcd1819666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2045af27-fe19-4170-ba72-32bcd1819666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692939676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce4136f-092d-42cc-b26f-d5521acc3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:23Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417a850a-fa46-41b1-ae41-2d6cea56b825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417a850a-fa46-41b1-ae41-2d6cea56b825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017bcff2-8791-42ae-9e38-715ec2636ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017bcff2-8791-42ae-9e38-715ec2636ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce4136f-092d-42cc-b26f-d5521acc3e62', 'volume_name': 'volume-1ce4136f-092d-42cc-b26f-d5521acc3e62', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fc82c1-d93c-4cb5-bf11-874e30889a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fc82c1-d93c-4cb5-bf11-874e30889a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b52ba32-d46b-4351-a257-c9e105944e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:22 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Volume 1ce4136f-092d-42cc-b26f-d5521acc3e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce4136f-092d-42cc-b26f-d5521acc3e62', 'volume_size': 1} Aug 28 16:29:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (41dd98e0-8a5a-4c3c-ab4e-823b39a69288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60076870-c451-4043-9382-bfa6449ada22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60076870-c451-4043-9382-bfa6449ada22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319914692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b4f6d6-6e7a-4121-a475-55317e3b4af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:23Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccb0028-ac09-4bd5-b102-5d4ff9abdc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccb0028-ac09-4bd5-b102-5d4ff9abdc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100bf417-fc28-4ed0-817a-de36ac807c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100bf417-fc28-4ed0-817a-de36ac807c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b4f6d6-6e7a-4121-a475-55317e3b4af5', 'volume_name': 'volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900a5951-34df-4a75-98e0-e6ed60377690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900a5951-34df-4a75-98e0-e6ed60377690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c9827d-e749-4e1a-924b-9938b6a5f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Volume f4b4f6d6-6e7a-4121-a475-55317e3b4af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5', 'volume_size': 1} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (7ded3b1c-b584-41cb-a7e4-c685ef8bb8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5124e5-07c3-4bb1-b0ff-463614a70c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5124e5-07c3-4bb1-b0ff-463614a70c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2015195051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bc163f-14b5-4531-b4ac-50c967c3103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:24Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673218f-d0ed-4678-9fdb-255ad9a48798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673218f-d0ed-4678-9fdb-255ad9a48798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92225133-a3af-46f6-810c-9fec81bda1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92225133-a3af-46f6-810c-9fec81bda1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bc163f-14b5-4531-b4ac-50c967c3103b', 'volume_name': 'volume-09bc163f-14b5-4531-b4ac-50c967c3103b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfeb9c3-172e-4a8a-befb-5bcef0183ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfeb9c3-172e-4a8a-befb-5bcef0183ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdd033-bd9f-4336-accd-80a9e82bf0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Volume 09bc163f-14b5-4531-b4ac-50c967c3103b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bc163f-14b5-4531-b4ac-50c967c3103b', 'volume_size': 1} Aug 28 16:29:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.352s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Uploaded volume to glance image-id: 977a1c3e-fbde-4cf9-8110-38972af83bfb. {{(pid=86193) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.738s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2085520628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe18c84-c851-4dfe-a4e6-53a0a6791efd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:04Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Creating volume 8fe18c84-c851-4dfe-a4e6-53a0a6791efd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:24 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:24 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd 1073741824 Aug 28 16:29:24 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-48e5b94f-7a18-494c-8148-14bc314e060e tempest-VolumesActionsTest-435368204 None] Copy volume to image completed successfully. Aug 28 16:29:24 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd 1073741824" returned: 0 in 0.557s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:24 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd Aug 28 16:29:24 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:24 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" returned: 0 in 0.273s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.229s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305982786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09149a-d59c-42d4-a579-bcc057dde4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:22Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Creating volume 6c09149a-d59c-42d4-a579-bcc057dde4c2 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:24 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b24df2-44b9-4ded-b49c-c02469e53bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:25 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 1073741824 Aug 28 16:29:25 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1928773b-d47e-43d2-89e2-e673e524ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Volume volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd (8fe18c84-c851-4dfe-a4e6-53a0a6791efd): created successfully Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1928773b-d47e-43d2-89e2-e673e524ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (6b297dff-df85-45e5-9e0e-73873003cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f903ba57-483e-46b8-bc75-cf7fd598e0ab tempest-VolumesListTestJSON-503932297 None] Created volume successfully. Aug 28 16:29:25 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 1073741824" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:25 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:25 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:25 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2" returned: 0 in 0.268s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.338s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326151479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752a24a3-9d2c-4a26-9135-7fec9d868e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:22Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Creating volume 752a24a3-9d2c-4a26-9135-7fec9d868e2c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:25 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:25 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c 1073741824 Aug 28 16:29:25 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b1aa87-4668-413e-96d9-8c9fbaadb747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c09149a-d59c-42d4-a579-bcc057dde4c2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4126b7e3-a466-4ebe-87c0-f098c0d3f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Volume volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 (6c09149a-d59c-42d4-a579-bcc057dde4c2): created successfully Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4126b7e3-a466-4ebe-87c0-f098c0d3f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (bf53c124-d0bf-4087-8480-364bac0315ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-91c0dc52-8f64-4ebb-93e1-16046f1419cf tempest-CreateVolumesFromImageTest-1248655227 None] Created volume successfully. Aug 28 16:29:26 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c 1073741824" returned: 0 in 0.517s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (03bb6b77-ef89-4236-949d-38ffddd09af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a70d14-79a6-4251-b4dd-6b5438a3991c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a70d14-79a6-4251-b4dd-6b5438a3991c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-793004406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2f75ef-b4ee-472e-987a-28e70b4fe6df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:26Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb3a2d-e474-42f8-a2b0-8499ba330e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fb3a2d-e474-42f8-a2b0-8499ba330e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6693931a-c28d-4158-b2e7-39989f916840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6693931a-c28d-4158-b2e7-39989f916840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2f75ef-b4ee-472e-987a-28e70b4fe6df', 'volume_name': 'volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbf2b59-2b61-4765-9562-1fa215964bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbf2b59-2b61-4765-9562-1fa215964bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ffddc-f580-427e-8523-af8c2b3647ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Volume fe2f75ef-b4ee-472e-987a-28e70b4fe6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df', 'volume_size': 1} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:26 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c Aug 28 16:29:26 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:26 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c" returned: 0 in 0.269s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.917s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692939676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce4136f-092d-42cc-b26f-d5521acc3e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:23Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Creating volume 1ce4136f-092d-42cc-b26f-d5521acc3e62 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:26 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:26 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 1073741824 Aug 28 16:29:26 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7653e1c3-7ab1-4d27-b537-f05bf8fbf0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaa4a34-a68a-4cd9-9621-2e5e7723088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Volume volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c (752a24a3-9d2c-4a26-9135-7fec9d868e2c): created successfully Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaa4a34-a68a-4cd9-9621-2e5e7723088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (88a36b30-b4ae-4a87-b5b3-d272b11be0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3bd2e8dc-bf07-4f62-9071-88fb2f378fcb tempest-CreateVolumesFromImageTest-1248655227 None] Created volume successfully. Aug 28 16:29:27 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 1073741824" returned: 0 in 0.433s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:27 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 Aug 28 16:29:27 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:27 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.189s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319914692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b4f6d6-6e7a-4121-a475-55317e3b4af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:23Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Creating volume f4b4f6d6-6e7a-4121-a475-55317e3b4af5 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:27 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b52ba32-d46b-4351-a257-c9e105944e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce4136f-092d-42cc-b26f-d5521acc3e62', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:27 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 1073741824 Aug 28 16:29:27 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c2ba2-3295-4ab6-b55f-3bfd3a2d01fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Volume volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 (1ce4136f-092d-42cc-b26f-d5521acc3e62): created successfully Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c2ba2-3295-4ab6-b55f-3bfd3a2d01fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (59a235fb-6ad5-4804-8e48-5859ada7b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cfc57ff8-7856-4e37-b353-d0c319f7d44d tempest-CreateVolumesFromImageTest-1248655227 None] Created volume successfully. Aug 28 16:29:27 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 1073741824" returned: 0 in 0.462s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:27 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 Aug 28 16:29:27 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:28 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.550s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2015195051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bc163f-14b5-4531-b4ac-50c967c3103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd4c4362de640738ebdba71f0564fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:24Z,use_quota=True,user_id='ac8a7830f28242aaa8d6db938ef62f96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Creating volume 09bc163f-14b5-4531-b4ac-50c967c3103b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:28 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c9827d-e749-4e1a-924b-9938b6a5f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:28 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b 1073741824 Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead5c4e-20b2-4330-bbae-1828a9678924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:28 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Volume volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 (f4b4f6d6-6e7a-4121-a475-55317e3b4af5): created successfully Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fead5c4e-20b2-4330-bbae-1828a9678924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (41dd98e0-8a5a-4c3c-ab4e-823b39a69288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-29cd17dd-43fa-4ae6-876a-8cf01c945b23 tempest-CreateVolumesFromImageTest-1248655227 None] Created volume successfully. Aug 28 16:29:28 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b 1073741824" returned: 0 in 0.450s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:28 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b Aug 28 16:29:28 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:29 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b" returned: 0 in 0.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.504s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdd033-bd9f-4336-accd-80a9e82bf0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bc163f-14b5-4531-b4ac-50c967c3103b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d837e81d-ad02-4b71-8b42-526eae0b1c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2653277-85a2-4d64-ac18-43e02d6da87d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Volume volume-09bc163f-14b5-4531-b4ac-50c967c3103b (09bc163f-14b5-4531-b4ac-50c967c3103b): created successfully Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d837e81d-ad02-4b71-8b42-526eae0b1c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Flow 'volume_create_manager' (7ded3b1c-b584-41cb-a7e4-c685ef8bb8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1b01ab86-3ba8-4f5b-b2cf-b19a4d0ea9f9 tempest-CreateVolumesFromImageTest-1248655227 None] Created volume successfully. Aug 28 16:29:29 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:29 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:29 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[80763ad1-9b18-439e-a547-103bc5beebde]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:29 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:29 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:29 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:29 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img Aug 28 16:29:29 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-09bc163f-14b5-4531-b4ac-50c967c3103b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-09bc163f-14b5-4531-b4ac-50c967c3103b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-quobyte-09bc163f-14b5-4531-b4ac-50c967c3103b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-09bc163f-14b5-4531-b4ac-50c967c3103b" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[250047a1-df0d-4888-8c50-d805f263b56b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:31 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b Aug 28 16:29:31 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:31 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:31 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:31 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b" returned: 0 in 1.007s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:31 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.551s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:29:32 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b Aug 28 16:29:32 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:32 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-09bc163f-14b5-4531-b4ac-50c967c3103b" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-09bc163f-14b5-4531-b4ac-50c967c3103b" released by "delete_volume" :: held 1.659s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Created reservations ['b8dec5c3-d333-429a-bab1-7407153c3721', '337be612-0e6c-4352-b08c-b6586b7adae0', 'cbb052e2-af7c-4339-90c5-19b954e1c18e', '3a8d457e-21be-41d1-a9d9-b4391f469a58'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:32 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:32 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-f4b4f6d6-6e7a-4121-a475-55317e3b4af5-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-f4b4f6d6-6e7a-4121-a475-55317e3b4af5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-quobyte-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211d2dd-a58b-4035-94b8-ee96e0b39e58]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:33 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.781s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Deleted volume successfully. Aug 28 16:29:33 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 Aug 28 16:29:33 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-368c8fd2-f77a-414f-b702-3e1f8a1f3f1f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-09bc163f-14b5-4531-b4ac-50c967c3103b-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:34 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" returned: 0 in 0.873s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:34 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5 Aug 28 16:29:34 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:34 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img" returned: 0 in 4.725s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd37e0-20d4-4d2d-ae2f-733816337d71]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:34 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" returned: 0 in 0.434s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-f4b4f6d6-6e7a-4121-a475-55317e3b4af5" released by "delete_volume" :: held 1.395s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:34 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:34 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Created reservations ['e8476c0d-2a1c-4d81-9046-762d36e5b857', '4174ab40-5196-4d78-845c-d98bf87af4fa', '8d15facb-1140-4bc2-b646-5de6977ce9fc', '52bbc681-d290-4596-9bcc-173557799afe'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:34 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:34 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:35 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.265s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Deleted volume successfully. Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7f275152-1e59-4231-a4c8-48a3b8424274 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-f4b4f6d6-6e7a-4121-a475-55317e3b4af5-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:35 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.601s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:29:35 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Converted 1024.00 MB image at 216.61 MB/s Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] 40da3238-507a-41b1-acb7-3688c24007de was raw, converting to qcow2 {{(pid=86193) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e08c881-397b-4c80-b8c5-957f164cbb61]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:35 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img Aug 28 16:29:35 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-1ce4136f-092d-42cc-b26f-d5521acc3e62-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:35 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img" returned: 0 in 0.368s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-1ce4136f-092d-42cc-b26f-d5521acc3e62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-quobyte-1ce4136f-092d-42cc-b26f-d5521acc3e62" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-1ce4136f-092d-42cc-b26f-d5521acc3e62" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[070ab852-3d69-407d-9d70-586a9714bf46]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:35 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img Aug 28 16:29:35 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:35 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 Aug 28 16:29:35 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:36 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img" returned: 1 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:36 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v Aug 28 16:29:36 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:36 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:36 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62 Aug 28 16:29:36 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:36 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Image conversion details: src /opt/stack/data/cinder/conversion/4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca.temp_image.40da3238-507a-41b1-acb7-3688c24007dee69k9bln.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:29:36 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad4de8-2bcb-42b2-b7bb-62dc2844151b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:36 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1ce4136f-092d-42cc-b26f-d5521acc3e62" returned: 0 in 0.249s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-1ce4136f-092d-42cc-b26f-d5521acc3e62" released by "delete_volume" :: held 0.680s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:36 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v Aug 28 16:29:36 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Created reservations ['f879fc5f-7acc-4174-a4f1-c085cc835890', '1fb927b4-20a7-401e-859b-7c3c3744718c', '999b5d0c-1970-4ab9-bd0b-edad6ed2d1ae', '2b70d98a-2b9f-42a6-bbd4-dd4fbe720a70'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:36 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:36 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:36 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_htz9uy4v" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Deleted volume successfully. Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-752a24a3-9d2c-4a26-9135-7fec9d868e2c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-752a24a3-9d2c-4a26-9135-7fec9d868e2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b5fb68c9-4e0d-46de-a4f1-bade6f98051f tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-1ce4136f-092d-42cc-b26f-d5521acc3e62-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-quobyte-752a24a3-9d2c-4a26-9135-7fec9d868e2c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-752a24a3-9d2c-4a26-9135-7fec9d868e2c" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a335e61-1c58-481f-ba8c-8cfa2d89f952]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:37 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c Aug 28 16:29:37 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:37 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:37 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c Aug 28 16:29:37 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:37 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-752a24a3-9d2c-4a26-9135-7fec9d868e2c" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-752a24a3-9d2c-4a26-9135-7fec9d868e2c" released by "delete_volume" :: held 0.670s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Created reservations ['c237c957-662b-42ba-881c-252093efde90', 'b6360fc7-6cf3-4fe1-9c63-25d813ef7597', 'e2fa97c4-0b27-4297-85f3-8c71eb605a39', 'b923940d-85c5-44ba-b766-351d8ccb63a0'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:37 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:37 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:38 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.267s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Deleted volume successfully. Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-6c09149a-d59c-42d4-a579-bcc057dde4c2-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-6c09149a-d59c-42d4-a579-bcc057dde4c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bd903a9e-c6f0-46f4-bb0a-78247fd5fbda tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-752a24a3-9d2c-4a26-9135-7fec9d868e2c-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "cinder-quobyte-6c09149a-d59c-42d4-a579-bcc057dde4c2" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-6c09149a-d59c-42d4-a579-bcc057dde4c2" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c274419-ceb0-4c1b-acb5-560272095298]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:38 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 Aug 28 16:29:38 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.451s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Uploaded volume to glance image-id: 40da3238-507a-41b1-acb7-3688c24007de. {{(pid=86193) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.089s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-793004406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2f75ef-b4ee-472e-987a-28e70b4fe6df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:26Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Creating volume fe2f75ef-b4ee-472e-987a-28e70b4fe6df {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:38 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:38 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df 1073741824 Aug 28 16:29:38 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f3eb12df-1dc6-4ce2-850a-24797fbdf652 tempest-VolumesActionsTest-435368204 None] Copy volume to image completed successfully. Aug 28 16:29:38 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2" returned: 0 in 0.410s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:38 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2 Aug 28 16:29:38 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:38 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6c09149a-d59c-42d4-a579-bcc057dde4c2" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:38 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-quobyte-6c09149a-d59c-42d4-a579-bcc057dde4c2" released by "delete_volume" :: held 0.747s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df 1073741824" returned: 0 in 0.419s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:39 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df Aug 28 16:29:39 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Created reservations ['7e37af2f-8006-49e0-8a8f-8478a0e543ee', '36b6d1d9-657b-493c-b1c1-52cfb1720989', '5aa238b5-cb7d-4b9d-907d-dc89365dcf33', 'ab2d309c-4844-442a-95d9-8cf45821c223'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:39 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:39 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:39 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" returned: 0 in 0.268s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ffddc-f580-427e-8523-af8c2b3647ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e88cbb-92e1-4448-b6b2-caba55cd8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:39 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Volume volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df (fe2f75ef-b4ee-472e-987a-28e70b4fe6df): created successfully Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e88cbb-92e1-4448-b6b2-caba55cd8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (03bb6b77-ef89-4236-949d-38ffddd09af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-104cd06c-927e-486f-a26a-015ce310cd10 tempest-VolumesListTestJSON-503932297 None] Created volume successfully. Aug 28 16:29:39 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Deleted volume successfully. Aug 28 16:29:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-623ec47e-0a23-41f8-8a0e-dabb48946601 tempest-CreateVolumesFromImageTest-1248655227 None] Lock "cinder-6c09149a-d59c-42d4-a579-bcc057dde4c2-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (96803c6a-83cf-494f-9bd4-fccadcf7a71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642329f2-e546-4403-b12d-22969b1ef90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642329f2-e546-4403-b12d-22969b1ef90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-315073166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e520ae-aeee-41ca-8c61-7709775324eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:40Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ac149-4d0b-4cb3-bb41-bf7966b295a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497ac149-4d0b-4cb3-bb41-bf7966b295a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06001105-5daa-4b91-89ce-dbc61584b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06001105-5daa-4b91-89ce-dbc61584b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e520ae-aeee-41ca-8c61-7709775324eb', 'volume_name': 'volume-57e520ae-aeee-41ca-8c61-7709775324eb', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c676eaa-be81-43aa-9c9d-201ff8bc41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c676eaa-be81-43aa-9c9d-201ff8bc41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068502e7-06cf-4d25-bb1a-2b463607bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Volume 57e520ae-aeee-41ca-8c61-7709775324eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e520ae-aeee-41ca-8c61-7709775324eb', 'volume_size': 1} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-315073166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e520ae-aeee-41ca-8c61-7709775324eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='79002b04a15e479eb71eab65fe6d8598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:40Z,use_quota=True,user_id='bf4355bbcdcc4ab082b34bd76a6b21d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Creating volume 57e520ae-aeee-41ca-8c61-7709775324eb {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:40 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:40 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb 1073741824 Aug 28 16:29:40 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Acquiring lock "cinder-quobyte-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "cinder-quobyte-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b31d9e-81dd-4516-aa24-f1975cd8e2ca]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:40 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:40 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:40 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb 1073741824" returned: 0 in 0.599s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:40 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.491s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:40 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca Aug 28 16:29:40 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:40 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb Aug 28 16:29:40 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:41 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:41 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb" returned: 0 in 0.342s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "cinder-quobyte-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca" released by "delete_volume" :: held 0.915s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068502e7-06cf-4d25-bb1a-2b463607bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e520ae-aeee-41ca-8c61-7709775324eb', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78be1a-1423-4a61-82d5-e639b9a04595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:41 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Volume volume-57e520ae-aeee-41ca-8c61-7709775324eb (57e520ae-aeee-41ca-8c61-7709775324eb): created successfully Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78be1a-1423-4a61-82d5-e639b9a04595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Flow 'volume_create_manager' (96803c6a-83cf-494f-9bd4-fccadcf7a71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a089ce1b-6b00-4571-840d-4cdfae006035 tempest-VolumesListTestJSON-503932297 None] Created volume successfully. Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Created reservations ['cc0f5309-eb90-40c4-be77-f21bca4a4f8b', '7daa15e8-fee8-4906-978f-61006c503b1e', '23f9fa9a-323e-4bd5-b31e-99ab2c4cd884', '3cd86f28-eb6a-4b94-8a36-fc5259aa5e79'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:41 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:41 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:41 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Deleted volume successfully. Aug 28 16:29:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c569ce0c-ffb4-4c61-82bf-4c60ed9d5b90 tempest-VolumesActionsTest-435368204 None] Lock "cinder-4f61d4b9-e3be-4d2d-ac77-9de1c5d94cca-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Flow 'volume_create_manager' (13677140-1ba6-4325-af8b-6840cfa3a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5c1afa-d8be-4438-aef0-a6cc72a0a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5c1afa-d8be-4438-aef0-a6cc72a0a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698322154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419f8205-86de-4cfc-9141-8f323e132f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50ee9cd444a4080a904fc07bddb0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:44Z,use_quota=True,user_id='2df661e49b2d414cb871dbcf9cdcef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c023537-ce8c-4ab2-871d-37cbdb4ee785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c023537-ce8c-4ab2-871d-37cbdb4ee785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a9ec0e-71eb-4f3b-a9bb-7e74f410c6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a9ec0e-71eb-4f3b-a9bb-7e74f410c6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419f8205-86de-4cfc-9141-8f323e132f7a', 'volume_name': 'volume-419f8205-86de-4cfc-9141-8f323e132f7a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967b099c-d71a-4221-bee0-abbf27514e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967b099c-d71a-4221-bee0-abbf27514e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca760591-b9b7-46bb-81e2-625cf188e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:44 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Volume 419f8205-86de-4cfc-9141-8f323e132f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419f8205-86de-4cfc-9141-8f323e132f7a', 'volume_size': 1} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698322154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419f8205-86de-4cfc-9141-8f323e132f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50ee9cd444a4080a904fc07bddb0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:44Z,use_quota=True,user_id='2df661e49b2d414cb871dbcf9cdcef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Creating volume 419f8205-86de-4cfc-9141-8f323e132f7a {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:44 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:44 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a 1073741824 Aug 28 16:29:44 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-57e520ae-aeee-41ca-8c61-7709775324eb-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "cinder-57e520ae-aeee-41ca-8c61-7709775324eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-quobyte-57e520ae-aeee-41ca-8c61-7709775324eb" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-57e520ae-aeee-41ca-8c61-7709775324eb" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6e7ea-e715-45b6-ae56-224ed6b2b3e2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:45 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a 1073741824" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:45 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a Aug 28 16:29:45 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:45 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb Aug 28 16:29:45 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:45 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca760591-b9b7-46bb-81e2-625cf188e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419f8205-86de-4cfc-9141-8f323e132f7a', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc208c90-c3c1-4da7-a14d-89f619227876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Volume volume-419f8205-86de-4cfc-9141-8f323e132f7a (419f8205-86de-4cfc-9141-8f323e132f7a): created successfully Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc208c90-c3c1-4da7-a14d-89f619227876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Flow 'volume_create_manager' (13677140-1ba6-4325-af8b-6840cfa3a12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d99e8e30-15bb-4c16-8528-858c91b994ca tempest-ProjectReaderTests-870541868 None] Created volume successfully. Aug 28 16:29:45 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb" returned: 0 in 0.435s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:45 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb Aug 28 16:29:45 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:45 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-57e520ae-aeee-41ca-8c61-7709775324eb" returned: 0 in 0.312s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-57e520ae-aeee-41ca-8c61-7709775324eb" released by "delete_volume" :: held 0.801s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Created reservations ['31420a00-239f-4997-b769-aec08ad98928', '0651497e-fff7-4f13-86e9-bcd024198b50', 'e86b169e-cbfe-4cd7-8bcb-cbb56048dd23', '4758dcff-cf1c-43be-aed1-d4e12be57e6e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:45 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:45 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-fe2f75ef-b4ee-472e-987a-28e70b4fe6df-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-fe2f75ef-b4ee-472e-987a-28e70b4fe6df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:46 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-quobyte-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Deleted volume successfully. Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4eca6aa9-7fd1-435c-8957-a6126689720d tempest-VolumesListTestJSON-503932297 None] Lock "cinder-57e520ae-aeee-41ca-8c61-7709775324eb-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968c0bf-1837-4f59-b53a-5e66f6a54e88]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:46 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df Aug 28 16:29:46 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Acquiring lock "cinder-419f8205-86de-4cfc-9141-8f323e132f7a-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "cinder-419f8205-86de-4cfc-9141-8f323e132f7a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Acquiring lock "cinder-quobyte-419f8205-86de-4cfc-9141-8f323e132f7a" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "cinder-quobyte-419f8205-86de-4cfc-9141-8f323e132f7a" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cee53e-711b-467f-b1c1-4eefbc3dcac0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:46 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" returned: 0 in 0.641s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:46 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df Aug 28 16:29:46 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:47 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a Aug 28 16:29:47 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:47 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" returned: 0 in 0.387s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-fe2f75ef-b4ee-472e-987a-28e70b4fe6df" released by "delete_volume" :: held 1.098s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:47 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a" returned: 0 in 0.498s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Created reservations ['a752ca4c-54f2-4966-95cc-6294ff7c32e7', 'b4288c9b-8832-428c-a5a7-6eb1fb4b37bc', 'c13ff2ec-f0e6-4194-9004-66f6c3494111', '7082140e-05e3-4e94-8ea1-4a2143e15423'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:47 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a Aug 28 16:29:47 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:47 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:47 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:47 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-419f8205-86de-4cfc-9141-8f323e132f7a" returned: 0 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "cinder-quobyte-419f8205-86de-4cfc-9141-8f323e132f7a" released by "delete_volume" :: held 0.938s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:47 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.328s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Deleted volume successfully. Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Created reservations ['ec96107f-f139-46d2-8cae-6bc8489cecc6', 'fe8706b1-3d2b-436a-83d1-f69a105b74a7', 'a6693fb9-cb22-4a08-91f0-91e9e80c854a', '75033e6b-2e9f-41d3-86f2-a8e30bf74338'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1c914cf2-825d-464c-8dc5-ad4463822a35 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-fe2f75ef-b4ee-472e-987a-28e70b4fe6df-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:48 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:48 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:48 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Deleted volume successfully. Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b312e6f3-2bfc-4aa8-91b4-37e47a78590b tempest-ProjectReaderTests-870541868 None] Lock "cinder-419f8205-86de-4cfc-9141-8f323e132f7a-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-8fe18c84-c851-4dfe-a4e6-53a0a6791efd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-8fe18c84-c851-4dfe-a4e6-53a0a6791efd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "cinder-quobyte-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d969ee-e0f1-48ad-af03-35696fbcd0a4]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:48 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd Aug 28 16:29:48 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:49 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" returned: 0 in 0.408s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:49 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd Aug 28 16:29:49 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:49 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-quobyte-8fe18c84-c851-4dfe-a4e6-53a0a6791efd" released by "delete_volume" :: held 0.742s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Created reservations ['d86258f2-7911-4f7d-839f-e6b57a151d24', '27fb0e98-cd8c-4842-afa2-0b2110e7084a', '643489b8-0ff7-4721-b768-fee537cefedc', '9a7992b3-1f60-44a4-8b9e-65f48341753a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:49 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:49 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Flow 'volume_create_manager' (ec69b897-f5c8-4686-88fa-38e26b60587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d10dd4-d905-4e60-b1c9-8acfff95791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d10dd4-d905-4e60-b1c9-8acfff95791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279176243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec736c02-7f0e-4a4e-8baf-6b2b671a004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50ee9cd444a4080a904fc07bddb0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:50Z,use_quota=True,user_id='2df661e49b2d414cb871dbcf9cdcef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d87de0-1b29-456a-9a57-cc5133687c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d87de0-1b29-456a-9a57-cc5133687c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6a0046-3151-4c56-97b3-389f4419f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6a0046-3151-4c56-97b3-389f4419f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec736c02-7f0e-4a4e-8baf-6b2b671a004c', 'volume_name': 'volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9ab12-d588-4322-8a57-27826e3a3446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd9ab12-d588-4322-8a57-27826e3a3446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86401ea-d9b2-4a72-a294-5cc9e8cb8788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:49 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Volume ec736c02-7f0e-4a4e-8baf-6b2b671a004c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c', 'volume_size': 1} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279176243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec736c02-7f0e-4a4e-8baf-6b2b671a004c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50ee9cd444a4080a904fc07bddb0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:50Z,use_quota=True,user_id='2df661e49b2d414cb871dbcf9cdcef50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Creating volume ec736c02-7f0e-4a4e-8baf-6b2b671a004c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:49 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:49 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c 1073741824 Aug 28 16:29:49 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:49 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.341s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Deleted volume successfully. Aug 28 16:29:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-41ce3dc0-52af-4c5c-8a5c-fc8714013d76 tempest-VolumesListTestJSON-503932297 None] Lock "cinder-8fe18c84-c851-4dfe-a4e6-53a0a6791efd-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:50 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c 1073741824" returned: 0 in 0.647s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:50 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c Aug 28 16:29:50 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:50 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86401ea-d9b2-4a72-a294-5cc9e8cb8788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f7e547-1913-453d-a7e1-11ba1d2c566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:50 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Volume volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c (ec736c02-7f0e-4a4e-8baf-6b2b671a004c): created successfully Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f7e547-1913-453d-a7e1-11ba1d2c566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Flow 'volume_create_manager' (ec69b897-f5c8-4686-88fa-38e26b60587d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-986e6e64-3f2a-469a-a779-4b280925e71c tempest-ProjectReaderTests-870541868 None] Created volume successfully. Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Flow 'volume_create_manager' (d7146caf-8934-4a06-9766-70ef2b6dc683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0a6643-2c5a-49dd-9199-eb2bfe80ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0a6643-2c5a-49dd-9199-eb2bfe80ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277221565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a962431-6c65-4995-8978-1c7ff869a164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163d092add4c4a41a2b957706baaa0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:51Z,use_quota=True,user_id='c5b04b8f73ba4f929f571c1d12169efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ef70bc-ccca-4aaa-925b-2bd3aefaf659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ef70bc-ccca-4aaa-925b-2bd3aefaf659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7684b7-39e8-418a-80ba-25f6ec7ef0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7684b7-39e8-418a-80ba-25f6ec7ef0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a962431-6c65-4995-8978-1c7ff869a164', 'volume_name': 'volume-4a962431-6c65-4995-8978-1c7ff869a164', 'volume_size': 2}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2d3858-05f9-4c8a-a321-134d4a20ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2d3858-05f9-4c8a-a321-134d4a20ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29be17b-d5e0-43ef-9cad-7f42f988de20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:51 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Volume 4a962431-6c65-4995-8978-1c7ff869a164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a962431-6c65-4995-8978-1c7ff869a164', 'volume_size': 2} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1277221565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a962431-6c65-4995-8978-1c7ff869a164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='163d092add4c4a41a2b957706baaa0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:29:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:29:51Z,use_quota=True,user_id='c5b04b8f73ba4f929f571c1d12169efc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Creating volume 4a962431-6c65-4995-8978-1c7ff869a164 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:29:51 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 2147483648 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:51 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 2147483648 Aug 28 16:29:51 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Acquiring lock "cinder-ec736c02-7f0e-4a4e-8baf-6b2b671a004c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "cinder-ec736c02-7f0e-4a4e-8baf-6b2b671a004c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Acquiring lock "cinder-quobyte-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "cinder-quobyte-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:51 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 2147483648" returned: 0 in 0.680s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21ae2a-8bb4-4013-ab07-61fe05c7a18c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:52 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 Aug 28 16:29:52 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:52 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c Aug 28 16:29:52 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:52 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29be17b-d5e0-43ef-9cad-7f42f988de20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a962431-6c65-4995-8978-1c7ff869a164', 'volume_size': 2}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9f2ec8-be07-4be1-95f8-cd981973bc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:29:52 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Volume volume-4a962431-6c65-4995-8978-1c7ff869a164 (4a962431-6c65-4995-8978-1c7ff869a164): created successfully Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9f2ec8-be07-4be1-95f8-cd981973bc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Flow 'volume_create_manager' (d7146caf-8934-4a06-9766-70ef2b6dc683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:29:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-19da0f38-8c9f-4f09-b7c9-8ba91ed9bf8d tempest-VolumesCloneNegativeTest-279069915 None] Created volume successfully. Aug 28 16:29:52 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" returned: 0 in 0.584s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:52 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c Aug 28 16:29:52 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:52 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" returned: 0 in 0.298s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "cinder-quobyte-ec736c02-7f0e-4a4e-8baf-6b2b671a004c" released by "delete_volume" :: held 0.937s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Created reservations ['730bda7d-47bb-4d1e-91f5-6be89389c722', 'e9e50762-bfc8-40ea-a338-33fedbd110f2', 'e1f0d8e7-e5ab-48fa-9c57-f84a7dce7e24', 'c000a93c-9a58-4068-a276-a714b9396d35'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:53 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:53 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:53 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.367s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Deleted volume successfully. Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b562c099-8ec1-4706-8dec-614053485ecc tempest-ProjectReaderTests-870541868 None] Lock "cinder-ec736c02-7f0e-4a4e-8baf-6b2b671a004c-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Acquiring lock "cinder-4a962431-6c65-4995-8978-1c7ff869a164-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "cinder-4a962431-6c65-4995-8978-1c7ff869a164-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Acquiring lock "cinder-quobyte-4a962431-6c65-4995-8978-1c7ff869a164" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "cinder-quobyte-4a962431-6c65-4995-8978-1c7ff869a164" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1024343-53ee-47d7-a77c-91d73e976e32]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:29:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:53 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 Aug 28 16:29:53 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:54 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:54 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164 Aug 28 16:29:54 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:54 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a962431-6c65-4995-8978-1c7ff869a164" returned: 0 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "cinder-quobyte-4a962431-6c65-4995-8978-1c7ff869a164" released by "delete_volume" :: held 0.903s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Created reservations ['c1f0028f-dff9-4f0d-a8ea-8623e3ca00bf', '1c4fe8bf-170f-435b-a54a-41a9904d881e', '52db895a-096a-4a5a-8db7-302fbb91a8bc', 'fbcc8c9b-6ed0-4eef-8162-d6c96f52ddd9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:29:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:29:54 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:29:54 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:29:55 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Aug 28 16:29:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.303s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:29:55 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:29:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Deleted volume successfully. Aug 28 16:29:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1e8f5662-0132-4b6c-9861-9310c24e2379 tempest-VolumesCloneNegativeTest-279069915 None] Lock "cinder-4a962431-6c65-4995-8978-1c7ff869a164-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Flow 'volume_create_manager' (bddf1487-3bf8-4022-9359-f51a15ecab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5df885-fa5b-4eea-9ec7-7f2dcb7593c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5df885-fa5b-4eea-9ec7-7f2dcb7593c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-61437177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4bcb92-15da-488b-8b1b-4fcdc0da888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3063acdcf0394b76bb1d0259aec5f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:00Z,use_quota=True,user_id='004a0ec221194e1782340e89c879f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70227624-19c3-4094-a15d-229bce031d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70227624-19c3-4094-a15d-229bce031d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526a7683-8bf4-4274-9773-ed41f61cd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526a7683-8bf4-4274-9773-ed41f61cd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf4bcb92-15da-488b-8b1b-4fcdc0da888b', 'volume_name': 'volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1518cb53-1acc-46a6-a279-c4e848da6158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1518cb53-1acc-46a6-a279-c4e848da6158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ea0583-7b9a-4fb9-b373-604e1d1e0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Trying to clone cf4bcb92-15da-488b-8b1b-4fcdc0da888b from image bfd32705-759a-4eec-aec1-8d911107c463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:30:01 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Image download 20.69 MB at 20.69 MB/s Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f937897-1dc6-4618-8f43-4b7f766f7889]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:01 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD Aug 28 16:30:01 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:01 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:01 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 is fetched for user 004a0ec221194e1782340e89c879f358. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e77840-4b7d-4817-82ad-07572914bbd0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:02 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD Aug 28 16:30:02 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:02 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-61437177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4bcb92-15da-488b-8b1b-4fcdc0da888b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3063acdcf0394b76bb1d0259aec5f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:00Z,use_quota=True,user_id='004a0ec221194e1782340e89c879f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Creating volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:02 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1073741824 Aug 28 16:30:02 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:03 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1073741824" returned: 0 in 0.519s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:03 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b Aug 28 16:30:03 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:03 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Attempting download of bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8640cdc-b4ad-4380-8f45-ea1c4e1d397c]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:03 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl Aug 28 16:30:03 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:03 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl" returned: 0 in 0.421s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:04 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl Aug 28 16:30:04 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:04 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl" returned: 1 in 0.424s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_e4uc5ejl' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac742de-9575-4192-b35e-7ae02eccbf14]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:04 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD Aug 28 16:30:04 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:04 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] bfd32705-759a-4eec-aec1-8d911107c463 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:30:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:04 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b Aug 28 16:30:04 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:07 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" returned: 0 in 2.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_ze_lp_thdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:30:07 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Converted 112.00 MB image at 48.88 MB/s Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:07 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1G Aug 28 16:30:07 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:07 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 1G" returned: 0 in 0.516s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Downloaded image bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 for user 004a0ec221194e1782340e89c879f358 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Marking volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Copying metadata from image bfd32705-759a-4eec-aec1-8d911107c463 to cf4bcb92-15da-488b-8b1b-4fcdc0da888b. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Creating volume glance metadata for volume cf4bcb92-15da-488b-8b1b-4fcdc0da888b backed by image bfd32705-759a-4eec-aec1-8d911107c463 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ea0583-7b9a-4fb9-b373-604e1d1e0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782f7a1e-cb2c-4b14-a8c4-9995717cd790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Volume volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b (cf4bcb92-15da-488b-8b1b-4fcdc0da888b): created successfully Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782f7a1e-cb2c-4b14-a8c4-9995717cd790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Flow 'volume_create_manager' (bddf1487-3bf8-4022-9359-f51a15ecab69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4818adb4-d099-4aeb-8163-a8f11928779f tempest-VolumesExtendTest-2028651686 None] Created volume successfully. Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5286e-8f41-4e98-96e4-33eb75b3ffe5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:08 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b Aug 28 16:30:08 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:08 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" returned: 0 in 0.513s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 2G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b 2G" returned: 0 in 0.135s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-54c6d745-d6e5-4168-a82f-26f27fe02d3a tempest-VolumesExtendTest-2028651686 None] Extend volume completed successfully. Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-cf4bcb92-15da-488b-8b1b-4fcdc0da888b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-cf4bcb92-15da-488b-8b1b-4fcdc0da888b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-quobyte-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd78ad2e-5a6d-477a-a84b-fd516db916cd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:09 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b Aug 28 16:30:09 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:10 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:10 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b Aug 28 16:30:10 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:10 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" returned: 0 in 0.307s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-cf4bcb92-15da-488b-8b1b-4fcdc0da888b" released by "delete_volume" :: held 0.846s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Created reservations ['1cd35655-8ea5-41a5-9e27-c4f635912a07', 'b228f127-eaff-40a6-aa54-b41c10cd0e84', '28d31b76-770c-42db-b3c1-0065c44a898d', 'fd388af2-b767-4b1f-9b29-4d79b06300c1'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:10 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:30:10 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:11 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.426s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:30:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Deleted volume successfully. Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f6bd442f-c6af-44e3-85be-53a1b7e5fad8 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-cf4bcb92-15da-488b-8b1b-4fcdc0da888b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Flow 'volume_create_manager' (a7881719-4401-4e3b-821f-10efa33fd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510ee2ef-60d2-40d6-9206-a40e1fc31218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510ee2ef-60d2-40d6-9206-a40e1fc31218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2034483119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc8073-88e2-4ac2-985b-d3bc25ec781d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3063acdcf0394b76bb1d0259aec5f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:11Z,use_quota=True,user_id='004a0ec221194e1782340e89c879f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dec95af-2962-4855-8194-eac8096c85be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dec95af-2962-4855-8194-eac8096c85be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf27b57-c909-4860-8a64-50a2e7203080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf27b57-c909-4860-8a64-50a2e7203080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bc8073-88e2-4ac2-985b-d3bc25ec781d', 'volume_name': 'volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a9da5a-93ec-4cbf-bc7c-7f001556c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a9da5a-93ec-4cbf-bc7c-7f001556c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f4b6e2-bbdf-4fd8-b0ab-6f6416298694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Volume 16bc8073-88e2-4ac2-985b-d3bc25ec781d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d', 'volume_size': 1} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2034483119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc8073-88e2-4ac2-985b-d3bc25ec781d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3063acdcf0394b76bb1d0259aec5f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:11Z,use_quota=True,user_id='004a0ec221194e1782340e89c879f358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Creating volume 16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:11 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d 1073741824 Aug 28 16:30:11 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:12 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d 1073741824" returned: 0 in 0.537s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:12 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:12 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:12 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f4b6e2-bbdf-4fd8-b0ab-6f6416298694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a5a01f-bffa-4cc4-862e-fad5216b7940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:12 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Volume volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d (16bc8073-88e2-4ac2-985b-d3bc25ec781d): created successfully Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a5a01f-bffa-4cc4-862e-fad5216b7940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Flow 'volume_create_manager' (a7881719-4401-4e3b-821f-10efa33fd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-65a1931f-4550-4ec0-af93-ec15872c6dcf tempest-VolumesExtendTest-2028651686 None] Created volume successfully. Aug 28 16:30:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Creating offline snapshot b2547f3c-cb3b-4792-ba7a-2d50d58641d2 of volume 16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:30:13 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[771fdbe7-f972-4019-bb25-23bb76530017]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:14 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:14 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:14 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.507s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:14 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 1G Aug 28 16:30:14 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:14 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 1G" returned: 0 in 0.578s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:15 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 Aug 28 16:30:15 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:15 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2" returned: 0 in 0.408s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:15 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 is being set with open permissions: ugo+rw Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:15 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 Aug 28 16:30:15 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:15 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2" returned: 0 in 0.298s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:15 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info Aug 28 16:30:15 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:16 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info" returned: 0 in 0.322s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:16 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info is being set with open permissions: ugo+rw Aug 28 16:30:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:16 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info Aug 28 16:30:16 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:16 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.info" returned: 0 in 0.268s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-80937bf3-5ed4-4d33-9b88-f0e196c6f6ec tempest-VolumesExtendTest-2028651686 None] Create snapshot completed successfully Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab26f9-1ec8-460f-b5ea-537b7f3e933d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:17 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:17 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:17 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.452s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 2G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 2G" returned: 0 in 0.158s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.656s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=111,cinder:UPDATE=143,cinder:INSERT=42,cinder:DELETE=12 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:30:17 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=101,cinder:UPDATE=155,cinder:DELETE=15,cinder:INSERT=37 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:30:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bad6fcf0-baf1-4667-b5fb-163344cec525 tempest-VolumesExtendTest-2028651686 None] Extend volume completed successfully. Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-b2547f3c-cb3b-4792-ba7a-2d50d58641d2-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-b2547f3c-cb3b-4792-ba7a-2d50d58641d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-quobyte-b2547f3c-cb3b-4792-ba7a-2d50d58641d2" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-b2547f3c-cb3b-4792-ba7a-2d50d58641d2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Deleting offline snapshot b2547f3c-cb3b-4792-ba7a-2d50d58641d2 of volume 16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] snapshot_file for this snap is: volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5efb73-1ba6-48d7-bfb4-192c1253dcfb]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:18 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 Aug 28 16:30:18 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:19 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2" returned: 0 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[85890781-865a-4a9c-9873-b4b94791dc5b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:19 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:19 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:19 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.449s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:19 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 Aug 28 16:30:19 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:20 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2" returned: 0 in 0.509s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:20 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2 Aug 28 16:30:20 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:20 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d.b2547f3c-cb3b-4792-ba7a-2d50d58641d2" returned: 0 in 0.307s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-b2547f3c-cb3b-4792-ba7a-2d50d58641d2" released by "_delete_snapshot" :: held 1.854s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" released by "delete_snapshot" :: held 1.884s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Created reservations ['e422d254-5ef5-40e6-a6ed-fed6e47651ee', 'b80d6097-1abd-47d0-abae-ac2a26ab91d0', '45888336-f589-44bf-8397-6c0ec403f04a', '632d5cb7-cb5f-4c1d-a85b-8297da51b404'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Delete snapshot completed successfully. Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4ad4f652-e378-46fa-b721-017b33a93550 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-b2547f3c-cb3b-4792-ba7a-2d50d58641d2-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-16bc8073-88e2-4ac2-985b-d3bc25ec781d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-16bc8073-88e2-4ac2-985b-d3bc25ec781d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4198b0-fdda-410f-a7c1-cff0daf59580]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:21 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:21 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:21 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.476s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:21 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d Aug 28 16:30:21 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:21 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-16bc8073-88e2-4ac2-985b-d3bc25ec781d" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-quobyte-16bc8073-88e2-4ac2-985b-d3bc25ec781d" released by "delete_volume" :: held 0.869s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Created reservations ['6a081974-c842-4b6a-a8a7-3b15e4888611', '5ba0dd78-bb79-41f1-a2af-7e60d8021254', 'a3d551a3-4f42-4714-9c8e-0eaa13db067f', '9a262050-898b-4a7f-8303-9a3c6a882ac7'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:22 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:30:22 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:22 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.332s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:30:22 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Deleted volume successfully. Aug 28 16:30:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b845c63f-8cac-483a-9c54-24a8cee79380 tempest-VolumesExtendTest-2028651686 None] Lock "cinder-16bc8073-88e2-4ac2-985b-d3bc25ec781d-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (2f2e68f3-e13f-46a9-b2ad-bea72dd80ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ced4b7-a0de-4ed7-b93e-c3953cf28ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ced4b7-a0de-4ed7-b93e-c3953cf28ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1915279027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e84e169-de7c-43b7-a375-08c18553fbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:27Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5fe5982-8428-4c52-abc6-7270a0956a49),volume_type_id=f5fe5982-8428-4c52-abc6-7270a0956a49)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06796d7b-9943-469f-9a84-dc771de37574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06796d7b-9943-469f-9a84-dc771de37574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346131f-5944-40c8-a80d-b2a37d2b1bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0346131f-5944-40c8-a80d-b2a37d2b1bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e84e169-de7c-43b7-a375-08c18553fbae', 'volume_name': 'volume-1e84e169-de7c-43b7-a375-08c18553fbae', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e660aef9-3822-4b30-b303-1fcf2836c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e660aef9-3822-4b30-b303-1fcf2836c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db066d89-4d2c-4a44-bd40-429a49228268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume 1e84e169-de7c-43b7-a375-08c18553fbae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e84e169-de7c-43b7-a375-08c18553fbae', 'volume_size': 1} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1915279027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e84e169-de7c-43b7-a375-08c18553fbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:27Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5fe5982-8428-4c52-abc6-7270a0956a49),volume_type_id=f5fe5982-8428-4c52-abc6-7270a0956a49)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Creating volume 1e84e169-de7c-43b7-a375-08c18553fbae {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:26 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:26 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae 1073741824 Aug 28 16:30:27 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (1919725e-8f3f-4061-b610-952a0c6c7b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1a925-a103-4043-9d4d-869cfe82d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1a925-a103-4043-9d4d-869cfe82d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-883880941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b1896c-a6b4-4d0b-9a80-c045e26e117d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:27Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff64b1a-88d0-46ed-a114-34749352389b),volume_type_id=2ff64b1a-88d0-46ed-a114-34749352389b)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b59e15-fc7f-4ca1-b14a-eacea52def98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b59e15-fc7f-4ca1-b14a-eacea52def98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35640cd-d466-413d-b69f-cca796744a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35640cd-d466-413d-b69f-cca796744a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b1896c-a6b4-4d0b-9a80-c045e26e117d', 'volume_name': 'volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06990ca0-8026-4199-81a9-556be0fa96c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06990ca0-8026-4199-81a9-556be0fa96c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b105945-a201-447b-b070-a90ecd7eb171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume f6b1896c-a6b4-4d0b-9a80-c045e26e117d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d', 'volume_size': 1} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:27 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae 1073741824" returned: 0 in 0.746s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:27 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae Aug 28 16:30:27 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:28 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae" returned: 0 in 0.430s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-883880941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b1896c-a6b4-4d0b-9a80-c045e26e117d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:27Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff64b1a-88d0-46ed-a114-34749352389b),volume_type_id=2ff64b1a-88d0-46ed-a114-34749352389b)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Creating volume f6b1896c-a6b4-4d0b-9a80-c045e26e117d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:28 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db066d89-4d2c-4a44-bd40-429a49228268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e84e169-de7c-43b7-a375-08c18553fbae', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82d5709-804e-44d2-b74e-ca6bc313a95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:28 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d 1073741824 Aug 28 16:30:28 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume volume-1e84e169-de7c-43b7-a375-08c18553fbae (1e84e169-de7c-43b7-a375-08c18553fbae): created successfully Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82d5709-804e-44d2-b74e-ca6bc313a95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (2f2e68f3-e13f-46a9-b2ad-bea72dd80ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bdc81f06-8967-41f1-878c-7f8e1a25e143 tempest-TestInstancesWithCinderVolumes-494937862 None] Created volume successfully. Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (69419544-e89a-4316-a476-f1c61a7aba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e6f04c-2672-4b48-a95b-2431e5a26bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e6f04c-2672-4b48-a95b-2431e5a26bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-613440497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de3dcda-5a68-40c0-a609-dabb00221c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:28Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a994891-67b5-44c8-9cdc-25d4664e51f5),volume_type_id=4a994891-67b5-44c8-9cdc-25d4664e51f5)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e4d199-35e4-4f68-b9ab-b14bde8ab8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e4d199-35e4-4f68-b9ab-b14bde8ab8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1574787e-0cac-4eb5-872e-7526c9defa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:30:28 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d 1073741824" returned: 0 in 0.697s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:28 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d Aug 28 16:30:28 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1574787e-0cac-4eb5-872e-7526c9defa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5de3dcda-5a68-40c0-a609-dabb00221c35', 'volume_name': 'volume-5de3dcda-5a68-40c0-a609-dabb00221c35', 'volume_size': 1, 'image_id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401951057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab2fbbb8676944aaab41f62effd1e07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'created_at': datetime.datetime(2026, 8, 28, 14, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 30, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf40e53-8aa8-412a-8d44-58b7ee3cd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf40e53-8aa8-412a-8d44-58b7ee3cd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f505cc13-6074-4f6a-b91b-a351c78414dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Volume 5de3dcda-5a68-40c0-a609-dabb00221c35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5de3dcda-5a68-40c0-a609-dabb00221c35', 'volume_size': 1, 'image_id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401951057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab2fbbb8676944aaab41f62effd1e07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'created_at': datetime.datetime(2026, 8, 28, 14, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 30, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477/file', 'properties': {}}, 'image_service': } Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Trying to clone 5de3dcda-5a68-40c0-a609-dabb00221c35 from image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:30:29 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" returned: 0 in 0.455s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b105945-a201-447b-b070-a90ecd7eb171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b25a2d-68ef-4163-85b0-2f0b1df7ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Volume volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d (f6b1896c-a6b4-4d0b-9a80-c045e26e117d): created successfully Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b25a2d-68ef-4163-85b0-2f0b1df7ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (1919725e-8f3f-4061-b610-952a0c6c7b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-20b95b7c-8ce1-4bc3-a413-747aef39c1a7 tempest-TestInstancesWithCinderVolumes-494937862 None] Created volume successfully. Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:31 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:30:31 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:31 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.394s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:30:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Flow 'volume_create_manager' (3724fed9-8321-4bef-b317-2a053555b7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc6ee1c-c38a-4269-9d68-cecacbc9e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc6ee1c-c38a-4269-9d68-cecacbc9e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1709634056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc14389-e460-4b06-a057-407b9dcbb9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfde7bb2aae346da8bd4271e27680ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:32Z,use_quota=True,user_id='5d59c5cd30934586b004fb0979cf1300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cdad0-54e7-4f4c-af1d-234652990d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934cdad0-54e7-4f4c-af1d-234652990d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e7e1b3-c6cc-4d49-b22d-21ac8dad353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e7e1b3-c6cc-4d49-b22d-21ac8dad353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc14389-e460-4b06-a057-407b9dcbb9be', 'volume_name': 'volume-5dc14389-e460-4b06-a057-407b9dcbb9be', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e6e5a8-f1a9-4bd3-a6de-7a23fc8cd4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e6e5a8-f1a9-4bd3-a6de-7a23fc8cd4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dea1dc9-0b8b-4b8d-8bbf-68b32bcc8ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:32 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Volume 5dc14389-e460-4b06-a057-407b9dcbb9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc14389-e460-4b06-a057-407b9dcbb9be', 'volume_size': 1} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1709634056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc14389-e460-4b06-a057-407b9dcbb9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfde7bb2aae346da8bd4271e27680ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:32Z,use_quota=True,user_id='5d59c5cd30934586b004fb0979cf1300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Creating volume 5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:32 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:32 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be 1073741824 Aug 28 16:30:32 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:32 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be 1073741824" returned: 0 in 0.557s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:32 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:32 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:33 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.298s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dea1dc9-0b8b-4b8d-8bbf-68b32bcc8ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc14389-e460-4b06-a057-407b9dcbb9be', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf9b8f-d0d9-4743-a6e7-87e22fa63455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:33 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Volume volume-5dc14389-e460-4b06-a057-407b9dcbb9be (5dc14389-e460-4b06-a057-407b9dcbb9be): created successfully Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf9b8f-d0d9-4743-a6e7-87e22fa63455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Flow 'volume_create_manager' (3724fed9-8321-4bef-b317-2a053555b7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f67c19da-c0ba-4260-94fb-34642c49e6df tempest-SnapshotDependencyTests-1686861800 None] Created volume successfully. Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD, size 20.69 MB, duration 4.38 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:30:33 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Image download 20.69 MB at 4.72 MB/s Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954f675-a16f-4d64-94ef-8b1492bbe6d0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:33 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD Aug 28 16:30:33 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:33 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:33 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Temporary image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 is fetched for user 5090f890332e4be1a0f66a6866c5e622. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ab188-88fa-4611-b8ba-2ffff103ce93]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:34 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD Aug 28 16:30:34 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:34 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-613440497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de3dcda-5a68-40c0-a609-dabb00221c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab2fbbb8676944aaab41f62effd1e07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:28Z,use_quota=True,user_id='5090f890332e4be1a0f66a6866c5e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a994891-67b5-44c8-9cdc-25d4664e51f5),volume_type_id=4a994891-67b5-44c8-9cdc-25d4664e51f5)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Creating volume 5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:34 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:34 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1073741824 Aug 28 16:30:34 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:34 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1073741824" returned: 0 in 0.529s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:35 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 Aug 28 16:30:35 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:35 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35" returned: 0 in 0.298s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Creating offline snapshot 053287c9-2d77-475e-855d-6321f81ff903 of volume 5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Attempting download of 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}])) to volume 5de3dcda-5a68-40c0-a609-dabb00221c35. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ab257d-b33b-4280-8aac-b3211d5f0820]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e7256-a106-4c25-8faf-777a78985807]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:35 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:35 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:35 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6 Aug 28 16:30:35 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:35 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.459s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:35 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6" returned: 0 in 0.434s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:35 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 1G Aug 28 16:30:35 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:36 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6 Aug 28 16:30:36 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:36 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6" returned: 1 in 0.531s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_wq244sp6' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[37869e39-c1f6-45fb-9622-d8a613b240bd]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:36 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 1G" returned: 0 in 0.703s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc14389-e460-4b06-a057-407b9dcbb9be -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:36 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD Aug 28 16:30:36 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:36 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc14389-e460-4b06-a057-407b9dcbb9be -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:36 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:36 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:30:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:36 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 Aug 28 16:30:36 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:37 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dc14389-e460-4b06-a057-407b9dcbb9be -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.464s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:37 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 is being set with open permissions: ugo+rw Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:37 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:37 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:37 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.372s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:37 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info Aug 28 16:30:37 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:37 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info" returned: 0 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:37 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info is being set with open permissions: ugo+rw Aug 28 16:30:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:37 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info Aug 28 16:30:37 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:38 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.info" returned: 0 in 0.406s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ef3d5fd7-e9c6-4391-a8f4-2cd48ac1bc2a tempest-SnapshotDependencyTests-1686861800 None] Create snapshot completed successfully Aug 28 16:30:39 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35" returned: 0 in 2.526s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0dd5a6ed-d985-43d2-8507-4e3c6a1f9477_b8u_uratdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:30:39 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Converted 112.00 MB image at 44.31 MB/s Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:39 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1G Aug 28 16:30:39 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Flow 'volume_create_manager' (253b402b-df6f-4b3c-aec3-fc3fab743571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b76fa52-2437-4148-a06a-0d2cef590de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b76fa52-2437-4148-a06a-0d2cef590de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d39a1b-5e41-438f-b72f-b07c12ee42c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfde7bb2aae346da8bd4271e27680ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=053287c9-2d77-475e-855d-6321f81ff903,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:30:40Z,use_quota=True,user_id='5d59c5cd30934586b004fb0979cf1300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4030678b-e6c6-45b6-8981-84465ec05663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:39 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4030678b-e6c6-45b6-8981-84465ec05663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7723077f-3dde-433b-800b-7150c763134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7723077f-3dde-433b-800b-7150c763134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38d39a1b-5e41-438f-b72f-b07c12ee42c7', 'volume_name': 'volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7', 'volume_size': 1, 'snapshot_id': '053287c9-2d77-475e-855d-6321f81ff903'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe94f8a-adea-4d85-8b42-565b523f4108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe94f8a-adea-4d85-8b42-565b523f4108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5073b95-2d78-4ae5-aed1-ba973f5553ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Volume 38d39a1b-5e41-438f-b72f-b07c12ee42c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7', 'volume_size': 1, 'snapshot_id': '053287c9-2d77-475e-855d-6321f81ff903'} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 1G" returned: 0 in 0.602s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Downloaded image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 ((None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}])) to volume 5de3dcda-5a68-40c0-a609-dabb00221c35 successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Temporary image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 for user 5090f890332e4be1a0f66a6866c5e622 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Marking volume 5de3dcda-5a68-40c0-a609-dabb00221c35 as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903-38d39a1b-5e41-438f-b72f-b07c12ee42c7" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Copying metadata from image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 to 5de3dcda-5a68-40c0-a609-dabb00221c35. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Creating volume glance metadata for volume 5de3dcda-5a68-40c0-a609-dabb00221c35 backed by image 0dd5a6ed-d985-43d2-8507-4e3c6a1f9477 with: {'image_id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'image_name': 'tempest-scenario-img--1401951057', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903-38d39a1b-5e41-438f-b72f-b07c12ee42c7" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Creating volume 38d39a1b-5e41-438f-b72f-b07c12ee42c7 from snapshot 053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] snapshot: 053287c9-2d77-475e-855d-6321f81ff903, volume: 38d39a1b-5e41-438f-b72f-b07c12ee42c7, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc52c1a9-4e5b-41ca-85fb-96275477ee74]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f505cc13-6074-4f6a-b91b-a351c78414dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de3dcda-5a68-40c0-a609-dabb00221c35', 'volume_size': 1, 'image_id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1401951057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab2fbbb8676944aaab41f62effd1e07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0dd5a6ed-d985-43d2-8507-4e3c6a1f9477', 'created_at': datetime.datetime(2026, 8, 28, 14, 30, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 30, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0dd5a6ed-d985-43d2-8507-4e3c6a1f9477/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab1e9c6-e7d4-4c10-a7db-e364cb423483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Volume volume-5de3dcda-5a68-40c0-a609-dabb00221c35 (5de3dcda-5a68-40c0-a609-dabb00221c35): created successfully Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab1e9c6-e7d4-4c10-a7db-e364cb423483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Flow 'volume_create_manager' (69419544-e89a-4316-a476-f1c61a7aba0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ef1cc972-28fe-4f26-8a76-a37fcf26aa5f tempest-TestInstancesWithCinderVolumes-494937862 None] Created volume successfully. Aug 28 16:30:40 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:40 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:40 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.434s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dc14389-e460-4b06-a057-407b9dcbb9be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7710cb2-6aff-4e06-9c8a-161a1640fed7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:40 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:40 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:41 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:30:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:30:41 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:30:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:41 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 Aug 28 16:30:41 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:46 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7" returned: 0 in 5.914s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:46 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:30:46 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Converted 1024.00 MB image at 173.12 MB/s Aug 28 16:30:46 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 is being set with open permissions: ugo+rw Aug 28 16:30:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:46 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 Aug 28 16:30:47 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:47 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7" returned: 0 in 0.370s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" released by "_copy_volume_from_snapshot" :: held 7.251s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903-38d39a1b-5e41-438f-b72f-b07c12ee42c7" released by "_create_volume_from_snapshot" :: held 7.347s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.377s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5073b95-2d78-4ae5-aed1-ba973f5553ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7', 'volume_size': 1, 'snapshot_id': '053287c9-2d77-475e-855d-6321f81ff903'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f07c61b-a3db-40e7-a49e-8332d69355ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:30:47 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Volume volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 (38d39a1b-5e41-438f-b72f-b07c12ee42c7): created successfully Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f07c61b-a3db-40e7-a49e-8332d69355ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Flow 'volume_create_manager' (253b402b-df6f-4b3c-aec3-fc3fab743571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:30:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4f409f16-828d-4d5b-bd2f-d32e3ba85895 tempest-SnapshotDependencyTests-1686861800 None] Created volume successfully. Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-053287c9-2d77-475e-855d-6321f81ff903-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-053287c9-2d77-475e-855d-6321f81ff903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:47 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Deleting offline snapshot 053287c9-2d77-475e-855d-6321f81ff903 of volume 5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] snapshot_file for this snap is: volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[25960d4b-1c57-446c-aff1-d5c290551b71]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a764ac53-23c3-4fb9-8b8a-fe1977a4ac04 req-03b9a217-1dcf-4dc3-ba9d-71b7a397b73d tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a764ac53-23c3-4fb9-8b8a-fe1977a4ac04 req-03b9a217-1dcf-4dc3-ba9d-71b7a397b73d tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-a764ac53-23c3-4fb9-8b8a-fe1977a4ac04 req-03b9a217-1dcf-4dc3-ba9d-71b7a397b73d tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-a764ac53-23c3-4fb9-8b8a-fe1977a4ac04 req-03b9a217-1dcf-4dc3-ba9d-71b7a397b73d tempest-TestInstancesWithCinderVolumes-494937862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-5de3dcda-5a68-40c0-a609-dabb00221c35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7187a22-326d-4828-8828-fe1023886546', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:30:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-a764ac53-23c3-4fb9-8b8a-fe1977a4ac04 req-03b9a217-1dcf-4dc3-ba9d-71b7a397b73d tempest-TestInstancesWithCinderVolumes-494937862 None] attachment_update completed successfully. Aug 28 16:30:48 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:48 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:48 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.515s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dc14389-e460-4b06-a057-407b9dcbb9be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a7413-e605-494c-8f34-0b20a58e669b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:48 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:48 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:49 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.601s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:49 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:49 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:49 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.424s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:49 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903 Aug 28 16:30:49 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:49 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be.053287c9-2d77-475e-855d-6321f81ff903" returned: 0 in 0.286s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-053287c9-2d77-475e-855d-6321f81ff903" released by "_delete_snapshot" :: held 2.021s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" released by "delete_snapshot" :: held 2.049s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:50 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Created reservations ['d3cfbe5f-5356-42c0-9543-1053f761542b', '338a5396-f6f7-46f2-8a47-09f2430bdf49', '91a3723b-9722-47c7-ac7e-dc94fd7a5765', '0d4adf5a-804d-4c4f-8c60-3c44b863384f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Delete snapshot completed successfully. Aug 28 16:30:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1eee5bed-318a-407b-9625-9bea639008b7 tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-053287c9-2d77-475e-855d-6321f81ff903-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-5dc14389-e460-4b06-a057-407b9dcbb9be-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-5dc14389-e460-4b06-a057-407b9dcbb9be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed263ce3-265a-497a-8570-763d3538ed6c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:51 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:51 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:52 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.789s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:52 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be Aug 28 16:30:52 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:52 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5dc14389-e460-4b06-a057-407b9dcbb9be" returned: 0 in 0.417s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-5dc14389-e460-4b06-a057-407b9dcbb9be" released by "delete_volume" :: held 1.307s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Created reservations ['97d3b042-2f33-4abb-bf69-1754dfc16da3', '893d8e3e-a4c8-4f38-98fe-5807e743fcc1', 'fd2f2723-c108-471d-b5e0-0fd1a6baed9a', 'eb94f4b2-806b-446d-8617-ba2b5510ea7a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:52 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:30:52 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:53 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:30:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Deleted volume successfully. Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d160685-d888-4dd0-9e60-b9c0a48a850f tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-5dc14389-e460-4b06-a057-407b9dcbb9be-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-38d39a1b-5e41-438f-b72f-b07c12ee42c7-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-38d39a1b-5e41-438f-b72f-b07c12ee42c7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c1612-a606-44ed-b86d-d040545e4b51]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:30:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:54 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 Aug 28 16:30:54 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:54 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7" returned: 0 in 0.631s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:54 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7 Aug 28 16:30:54 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:54 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-38d39a1b-5e41-438f-b72f-b07c12ee42c7" returned: 0 in 0.393s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-quobyte-38d39a1b-5e41-438f-b72f-b07c12ee42c7" released by "delete_volume" :: held 1.122s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Created reservations ['848e73f1-9edc-4e1b-b6a7-d3e4603ad7a1', '0549d312-3799-4c57-a4e8-3f1f381a1504', '71b23c30-3ef4-492f-96d9-5c7762e4db2c', '717d643e-02f1-4c33-bf6f-f4db5d0f26ae'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:30:55 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:30:55 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:30:55 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.522s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:30:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Deleted volume successfully. Aug 28 16:30:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-53533a1c-2a53-4697-97e6-b96fa7dc305e tempest-SnapshotDependencyTests-1686861800 None] Lock "cinder-38d39a1b-5e41-438f-b72f-b07c12ee42c7-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Flow 'volume_create_manager' (22e018ed-f348-48cd-8614-9d537ec5804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dcfb92-ed50-4815-809d-726ed9d7f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dcfb92-ed50-4815-809d-726ed9d7f84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1353933638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef395f6-b43e-42b0-947e-c75d60d58825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa660e10fde477398f7cf39df61bb86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:31:07Z,use_quota=True,user_id='9a5ca1e7f8d04c7b93d1068a7bad5371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f1aa14-345c-4db4-bdba-d09ed3b5e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f1aa14-345c-4db4-bdba-d09ed3b5e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d02d82d-adaf-4cc0-9f29-09a8a9bb6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d02d82d-adaf-4cc0-9f29-09a8a9bb6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ef395f6-b43e-42b0-947e-c75d60d58825', 'volume_name': 'volume-5ef395f6-b43e-42b0-947e-c75d60d58825', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68d9929-8e27-44bf-801d-e3e9bd269162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68d9929-8e27-44bf-801d-e3e9bd269162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa34929-a4d1-4ec2-9f6a-1e735559971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Volume 5ef395f6-b43e-42b0-947e-c75d60d58825: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ef395f6-b43e-42b0-947e-c75d60d58825', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 16:31:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Trying to clone 5ef395f6-b43e-42b0-947e-c75d60d58825 from image bfd32705-759a-4eec-aec1-8d911107c463 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:31:08 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:31:08 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Image download 20.69 MB at 20.69 MB/s Aug 28 16:31:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f6ca9-38d2-47c2-870e-bfa982db60b9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:08 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD Aug 28 16:31:08 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:08 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:08 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 is fetched for user 9a5ca1e7f8d04c7b93d1068a7bad5371. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad474fb-e0f6-4cb7-b8c4-f41b0922a5e0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:09 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD Aug 28 16:31:09 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:09 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1353933638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef395f6-b43e-42b0-947e-c75d60d58825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa660e10fde477398f7cf39df61bb86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:31:07Z,use_quota=True,user_id='9a5ca1e7f8d04c7b93d1068a7bad5371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Creating volume 5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:31:09 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:31:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:09 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1073741824 Aug 28 16:31:09 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:10 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1073741824" returned: 0 in 0.562s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:10 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 Aug 28 16:31:10 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:10 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825" returned: 0 in 0.277s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Attempting download of bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 5ef395f6-b43e-42b0-947e-c75d60d58825. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed0c29-d983-4da9-8fc2-b493d7a87bfa]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:10 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4 Aug 28 16:31:10 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:10 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4" returned: 0 in 0.431s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:11 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4 Aug 28 16:31:11 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:11 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4" returned: 1 in 0.452s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfd32705-759a-4eec-aec1-8d911107c463_awj1xpp4' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648900e-9d2d-417d-ab6d-43e2118bee80]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:11 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD Aug 28 16:31:11 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:11 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] bfd32705-759a-4eec-aec1-8d911107c463 was qcow2, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:31:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:11 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 Aug 28 16:31:11 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:13 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825" returned: 0 in 1.902s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:13 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfd32705-759a-4eec-aec1-8d911107c463_0yd8wa76devstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:31:13 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Converted 112.00 MB image at 58.83 MB/s Aug 28 16:31:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:13 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1G Aug 28 16:31:13 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:14 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 1G" returned: 0 in 0.367s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Downloaded image bfd32705-759a-4eec-aec1-8d911107c463 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}])) to volume 5ef395f6-b43e-42b0-947e-c75d60d58825 successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Temporary image bfd32705-759a-4eec-aec1-8d911107c463 for user 9a5ca1e7f8d04c7b93d1068a7bad5371 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Marking volume 5ef395f6-b43e-42b0-947e-c75d60d58825 as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Copying metadata from image bfd32705-759a-4eec-aec1-8d911107c463 to 5ef395f6-b43e-42b0-947e-c75d60d58825. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Creating volume glance metadata for volume 5ef395f6-b43e-42b0-947e-c75d60d58825 backed by image bfd32705-759a-4eec-aec1-8d911107c463 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa34929-a4d1-4ec2-9f6a-1e735559971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef395f6-b43e-42b0-947e-c75d60d58825', 'volume_size': 1, 'image_id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfd32705-759a-4eec-aec1-8d911107c463', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00930d9b5d15403f9338b0168c5090da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfd32705-759a-4eec-aec1-8d911107c463', 'created_at': datetime.datetime(2026, 8, 28, 14, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfd32705-759a-4eec-aec1-8d911107c463/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d7fc9-8921-4dac-b821-5fb27cb0236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:31:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Volume volume-5ef395f6-b43e-42b0-947e-c75d60d58825 (5ef395f6-b43e-42b0-947e-c75d60d58825): created successfully Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853d7fc9-8921-4dac-b821-5fb27cb0236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:31:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Flow 'volume_create_manager' (22e018ed-f348-48cd-8614-9d537ec5804a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:31:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ad271c90-4e71-4822-98b6-96529e86bbda tempest-TestShelveInstance-427898352 None] Created volume successfully. Aug 28 16:31:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c8374aca-8390-46db-878b-d8a849ccecde req-903e1c88-890b-4df9-b16d-c891e714e33c tempest-TestShelveInstance-427898352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c8374aca-8390-46db-878b-d8a849ccecde req-903e1c88-890b-4df9-b16d-c891e714e33c tempest-TestShelveInstance-427898352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c8374aca-8390-46db-878b-d8a849ccecde req-903e1c88-890b-4df9-b16d-c891e714e33c tempest-TestShelveInstance-427898352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-c8374aca-8390-46db-878b-d8a849ccecde req-903e1c88-890b-4df9-b16d-c891e714e33c tempest-TestShelveInstance-427898352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-5ef395f6-b43e-42b0-947e-c75d60d58825', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8aab872-c2d5-4180-a6ec-8e278b3356c0', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:31:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-c8374aca-8390-46db-878b-d8a849ccecde req-903e1c88-890b-4df9-b16d-c891e714e33c tempest-TestShelveInstance-427898352 None] attachment_update completed successfully. Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=79,cinder:UPDATE=59,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=68,cinder:DELETE=4 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-10740b4e-fc86-4af9-9617-bcbdcca485ce req-a9994e2b-4c2b-4ed6-b7e4-a6bd27267f86 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-10740b4e-fc86-4af9-9617-bcbdcca485ce req-a9994e2b-4c2b-4ed6-b7e4-a6bd27267f86 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-10740b4e-fc86-4af9-9617-bcbdcca485ce req-a9994e2b-4c2b-4ed6-b7e4-a6bd27267f86 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-10740b4e-fc86-4af9-9617-bcbdcca485ce req-a9994e2b-4c2b-4ed6-b7e4-a6bd27267f86 tempest-TestInstancesWithCinderVolumes-494937862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-1e84e169-de7c-43b7-a375-08c18553fbae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a9c68a5-f25f-46dc-a7a4-464eae963f67', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:31:22 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-10740b4e-fc86-4af9-9617-bcbdcca485ce req-a9994e2b-4c2b-4ed6-b7e4-a6bd27267f86 tempest-TestInstancesWithCinderVolumes-494937862 None] attachment_update completed successfully. Aug 28 16:31:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c9338b3f-cf7f-418e-98cd-844d55f546f0 req-b649996b-f0fe-40a6-a5a1-1e0e12000a11 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c9338b3f-cf7f-418e-98cd-844d55f546f0 req-b649996b-f0fe-40a6-a5a1-1e0e12000a11 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-c9338b3f-cf7f-418e-98cd-844d55f546f0 req-b649996b-f0fe-40a6-a5a1-1e0e12000a11 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-c9338b3f-cf7f-418e-98cd-844d55f546f0 req-b649996b-f0fe-40a6-a5a1-1e0e12000a11 tempest-TestInstancesWithCinderVolumes-494937862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bc29c97-6fe4-4319-97d4-63319c67f28c', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:31:25 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-c9338b3f-cf7f-418e-98cd-844d55f546f0 req-b649996b-f0fe-40a6-a5a1-1e0e12000a11 tempest-TestInstancesWithCinderVolumes-494937862 None] attachment_update completed successfully. Aug 28 16:31:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-9895d318-7d69-4e47-9daa-cb92acde00c1 req-2af44cd4-f893-4312-b420-1b5b9d3204e8 tempest-TestInstancesWithCinderVolumes-494937862 None] Terminate volume connection completed successfully. Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-9895d318-7d69-4e47-9daa-cb92acde00c1 req-2af44cd4-f893-4312-b420-1b5b9d3204e8 tempest-TestInstancesWithCinderVolumes-494937862 None] Deleting attachment 9a9c68a5-f25f-46dc-a7a4-464eae963f67. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:31 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:31:31 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:31 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.296s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:31:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-1e84e169-de7c-43b7-a375-08c18553fbae-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-1e84e169-de7c-43b7-a375-08c18553fbae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-quobyte-1e84e169-de7c-43b7-a375-08c18553fbae" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-1e84e169-de7c-43b7-a375-08c18553fbae" acquired by "delete_volume" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c80b1de-3c94-4fb4-9b4a-07febd9b829c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:32 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae Aug 28 16:31:32 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:32 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae" returned: 0 in 0.473s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:32 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae Aug 28 16:31:32 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:33 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1e84e169-de7c-43b7-a375-08c18553fbae" returned: 0 in 0.308s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-1e84e169-de7c-43b7-a375-08c18553fbae" released by "delete_volume" :: held 0.832s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:33 devstack cinder-volume[86193]: WARNING cinder.quota [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486489884-1850808560 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486489884-1850808560, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:33 devstack cinder-volume[86193]: WARNING cinder.quota [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486489884-1850808560 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486489884-1850808560, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Created reservations ['54f425e3-d9c9-4390-bdfa-7f360c6d4ee8', 'e2ef4f5b-6f85-477b-b6d4-227ebf3aa969', '3ac6eb47-af6e-4fac-bf30-1d9bde836474', '89884bde-3baf-414b-a475-e4867b299bd1'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:33 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:31:33 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:33 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:31:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Deleted volume successfully. Aug 28 16:31:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7a228130-bbab-4cae-bedb-f6730df25f76 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-1e84e169-de7c-43b7-a375-08c18553fbae-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-f57077a8-658c-424d-aadb-f2ac5b018fca req-b9e38c22-48fd-441a-a04c-98634b4c5642 tempest-TestInstancesWithCinderVolumes-494937862 None] Terminate volume connection completed successfully. Aug 28 16:31:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-f57077a8-658c-424d-aadb-f2ac5b018fca req-b9e38c22-48fd-441a-a04c-98634b4c5642 tempest-TestInstancesWithCinderVolumes-494937862 None] Deleting attachment 8bc29c97-6fe4-4319-97d4-63319c67f28c. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:31:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-f6b1896c-a6b4-4d0b-9a80-c045e26e117d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-f6b1896c-a6b4-4d0b-9a80-c045e26e117d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-quobyte-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881b224-f27e-428e-841d-27e201d3f080]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:37 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d Aug 28 16:31:37 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:37 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" returned: 0 in 0.488s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:37 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d Aug 28 16:31:37 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:37 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" returned: 0 in 0.333s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-f6b1896c-a6b4-4d0b-9a80-c045e26e117d" released by "delete_volume" :: held 0.875s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:37 devstack cinder-volume[86193]: WARNING cinder.quota [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2065923635-1889179103 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2065923635-1889179103, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:37 devstack cinder-volume[86193]: WARNING cinder.quota [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2065923635-1889179103 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2065923635-1889179103, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Created reservations ['1ca5f6b9-ac4e-4bc5-bbf5-e02fc204ecc7', '8d4f5157-7edf-431d-b450-26cfaf3e6e26', 'd3b80901-6000-4ee0-b8b7-329831a52e73', 'c4ba1ce7-1564-4339-9ce9-da3cf52caf69'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:38 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:31:38 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:38 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.347s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:31:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Deleted volume successfully. Aug 28 16:31:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-55f08d91-0996-4782-a496-52493e922f50 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-f6b1896c-a6b4-4d0b-9a80-c045e26e117d-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:41 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-234127de-9446-4826-b5cd-de933ff58fe5 req-58e83a4a-b1c2-4693-8acb-f9cba8fcaddf tempest-TestInstancesWithCinderVolumes-494937862 None] Terminate volume connection completed successfully. Aug 28 16:31:41 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-234127de-9446-4826-b5cd-de933ff58fe5 req-58e83a4a-b1c2-4693-8acb-f9cba8fcaddf tempest-TestInstancesWithCinderVolumes-494937862 None] Deleting attachment c7187a22-326d-4828-8828-fe1023886546. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-5de3dcda-5a68-40c0-a609-dabb00221c35-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-5de3dcda-5a68-40c0-a609-dabb00221c35-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "cinder-quobyte-5de3dcda-5a68-40c0-a609-dabb00221c35" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-5de3dcda-5a68-40c0-a609-dabb00221c35" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d686eb53-6098-42e7-841d-c669ad601185]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:42 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 Aug 28 16:31:42 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:42 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35" returned: 0 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:42 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35 Aug 28 16:31:42 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:43 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5de3dcda-5a68-40c0-a609-dabb00221c35" returned: 0 in 0.250s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-quobyte-5de3dcda-5a68-40c0-a609-dabb00221c35" released by "delete_volume" :: held 0.645s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:43 devstack cinder-volume[86193]: WARNING cinder.quota [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842341439-2000166392 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842341439-2000166392, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:43 devstack cinder-volume[86193]: WARNING cinder.quota [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842341439-2000166392 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842341439-2000166392, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Created reservations ['77ea4ea4-e82d-4fc1-9a79-1ced8cc9967b', '37e8d520-d666-4b32-9ecb-d4a2cf444299', 'f03b303b-5424-4efe-8337-f93d1a0b2ce4', 'b825713e-89e7-4ce0-9a43-d2ea080f00b6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:31:43 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:31:43 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:31:43 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:31:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Deleted volume successfully. Aug 28 16:31:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4329b573-1cfa-492c-bbaf-6ccc0303e219 tempest-TestInstancesWithCinderVolumes-494937862 None] Lock "cinder-5de3dcda-5a68-40c0-a609-dabb00221c35-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:31:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-4fa24b4c-fa46-4fca-ae18-6942035b35e1 req-d95999d5-ce46-4d55-b087-55a43e13acb1 tempest-TestShelveInstance-427898352 None] Terminate volume connection completed successfully. Aug 28 16:31:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-4fa24b4c-fa46-4fca-ae18-6942035b35e1 req-d95999d5-ce46-4d55-b087-55a43e13acb1 tempest-TestShelveInstance-427898352 None] Deleting attachment d8aab872-c2d5-4180-a6ec-8e278b3356c0. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:31:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6fdc7f6e-dec8-4471-82fe-7b12a86ec0e9 req-a1f5893c-2bb0-428e-8d11-5a01908a9a30 tempest-TestShelveInstance-427898352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:31:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6fdc7f6e-dec8-4471-82fe-7b12a86ec0e9 req-a1f5893c-2bb0-428e-8d11-5a01908a9a30 tempest-TestShelveInstance-427898352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:31:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-6fdc7f6e-dec8-4471-82fe-7b12a86ec0e9 req-a1f5893c-2bb0-428e-8d11-5a01908a9a30 tempest-TestShelveInstance-427898352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:31:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-6fdc7f6e-dec8-4471-82fe-7b12a86ec0e9 req-a1f5893c-2bb0-428e-8d11-5a01908a9a30 tempest-TestShelveInstance-427898352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-5ef395f6-b43e-42b0-947e-c75d60d58825', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d72818e-8144-4781-9f21-d12c7064f2a6', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:31:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-6fdc7f6e-dec8-4471-82fe-7b12a86ec0e9 req-a1f5893c-2bb0-428e-8d11-5a01908a9a30 tempest-TestShelveInstance-427898352 None] attachment_update completed successfully. Aug 28 16:32:03 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=44,cinder:UPDATE=30,cinder:INSERT=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:03 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=31,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Flow 'volume_create_manager' (4490a8cf-5634-4370-ab2c-2c506bc1f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050252ad-3ebb-4382-92de-879534288989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050252ad-3ebb-4382-92de-879534288989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2025887389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564378ea1ad42c79e4f6401c197b46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:32:22Z,use_quota=True,user_id='272762c7f8994fe7a882017631293b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13565055-7d09-4c18-9ca9-e593a0bb59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13565055-7d09-4c18-9ca9-e593a0bb59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3037b6-ab9a-4928-9cb6-612e6dbe58dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3037b6-ab9a-4928-9cb6-612e6dbe58dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2', 'volume_name': 'volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fd5d54-08a9-4481-9efa-1b900f2d8382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fd5d54-08a9-4481-9efa-1b900f2d8382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089aeedc-2a55-4617-8eb6-78bb2eba4f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:21 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Volume c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2', 'volume_size': 1} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2025887389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564378ea1ad42c79e4f6401c197b46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:32:22Z,use_quota=True,user_id='272762c7f8994fe7a882017631293b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Creating volume c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:32:21 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:32:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:21 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 1073741824 Aug 28 16:32:21 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:22 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 1073741824" returned: 0 in 0.474s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:22 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:32:22 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:22 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089aeedc-2a55-4617-8eb6-78bb2eba4f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba884a4-5b8d-43de-91aa-d611fd4d7412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:32:22 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Volume volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 (c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2): created successfully Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba884a4-5b8d-43de-91aa-d611fd4d7412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:32:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Flow 'volume_create_manager' (4490a8cf-5634-4370-ab2c-2c506bc1f908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:32:22 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4748d24c-d2bb-4302-8ef3-99fca0da43ee tempest-TestStampPattern-1400269941 None] Created volume successfully. Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:31 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:32:31 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:31 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:32:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:32:32 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:32 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-31797bfb-948d-4b27-936a-d9d802c79396 req-4d9cfd4a-29e5-4378-a3ab-8da3c06cb2c6 tempest-TestShelveInstance-427898352 None] Terminate volume connection completed successfully. Aug 28 16:32:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-31797bfb-948d-4b27-936a-d9d802c79396 req-4d9cfd4a-29e5-4378-a3ab-8da3c06cb2c6 tempest-TestShelveInstance-427898352 None] Deleting attachment 2d72818e-8144-4781-9f21-d12c7064f2a6. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Acquiring lock "cinder-5ef395f6-b43e-42b0-947e-c75d60d58825-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "cinder-5ef395f6-b43e-42b0-947e-c75d60d58825-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Acquiring lock "cinder-quobyte-5ef395f6-b43e-42b0-947e-c75d60d58825" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "cinder-quobyte-5ef395f6-b43e-42b0-947e-c75d60d58825" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93eea2a-255b-43af-957d-59741454c4a0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:38 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 Aug 28 16:32:38 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:38 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:38 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825 Aug 28 16:32:38 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:39 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-5ef395f6-b43e-42b0-947e-c75d60d58825" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "cinder-quobyte-5ef395f6-b43e-42b0-947e-c75d60d58825" released by "delete_volume" :: held 0.788s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.quota [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Created reservations ['acaef058-39e0-4f45-ac3f-f5f5b77524ee', 'e630c74f-7c0a-47ef-8248-f8f1a5547069', 'a3ad6e2f-c89e-43e3-9a2f-2d662307f440', '0c26f8d8-4692-4054-bb7e-ef6d81070eef'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:39 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:32:39 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:39 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.327s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.manager [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:32:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Deleted volume successfully. Aug 28 16:32:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [req-31797bfb-948d-4b27-936a-d9d802c79396 req-254b0dd4-ca27-4401-8a47-7a3f29ceb372 tempest-TestShelveInstance-427898352 None] Lock "cinder-5ef395f6-b43e-42b0-947e-c75d60d58825-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:32:49 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:49 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:32:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-8dd09d7f-5d91-42aa-9181-dfa52721121a req-536a848a-d634-4d4a-a41a-a1ec25e52eec tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-8dd09d7f-5d91-42aa-9181-dfa52721121a req-536a848a-d634-4d4a-a41a-a1ec25e52eec tempest-TestStampPattern-1400269941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-8dd09d7f-5d91-42aa-9181-dfa52721121a req-536a848a-d634-4d4a-a41a-a1ec25e52eec tempest-TestStampPattern-1400269941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:32:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-8dd09d7f-5d91-42aa-9181-dfa52721121a req-536a848a-d634-4d4a-a41a-a1ec25e52eec tempest-TestStampPattern-1400269941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3ce369b-1f6d-4c02-9106-2cce12942122', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:32:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-8dd09d7f-5d91-42aa-9181-dfa52721121a req-536a848a-d634-4d4a-a41a-a1ec25e52eec tempest-TestStampPattern-1400269941 None] attachment_update completed successfully. Aug 28 16:32:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-53d7fa24-f7f2-4db4-9756-e1029fa4fd4d req-c354130c-8613-49f1-870e-de5e88584bc9 tempest-TestStampPattern-1400269941 None] Terminate volume connection completed successfully. Aug 28 16:32:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-53d7fa24-f7f2-4db4-9756-e1029fa4fd4d req-c354130c-8613-49f1-870e-de5e88584bc9 tempest-TestStampPattern-1400269941 None] Deleting attachment a3ce369b-1f6d-4c02-9106-2cce12942122. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:32:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:32:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:32:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Creating offline snapshot 05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 of volume c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:32:58 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700201d-7a0d-4112-b42e-d3527bf0f5da]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:32:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:59 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:32:59 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:59 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:59 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 1G Aug 28 16:32:59 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:32:59 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Aug 28 16:32:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 1G" returned: 0 in 0.432s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:32:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:32:59 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:32:59 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:00 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.300s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:00 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 is being set with open permissions: ugo+rw Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:00 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:33:00 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:00 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:00 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info Aug 28 16:33:00 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:00 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:00 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info is being set with open permissions: ugo+rw Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:00 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info Aug 28 16:33:00 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:00 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.info" returned: 0 in 0.252s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b6b5b5a9-1fe9-4bac-ad70-0bfc82e1f017 tempest-TestStampPattern-1400269941 None] Create snapshot completed successfully Aug 28 16:33:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Flow 'volume_create_manager' (9224df3a-e9d0-41f9-ba9c-1c60888cc860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe25f43-d886-44bd-b97a-55a21bb8bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe25f43-d886-44bd-b97a-55a21bb8bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1625419820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e4a3b0-29fc-455a-bc1f-465d53435c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564378ea1ad42c79e4f6401c197b46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:33:09Z,use_quota=True,user_id='272762c7f8994fe7a882017631293b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27afecf9-4d92-4a7d-ae04-1fb957fec521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27afecf9-4d92-4a7d-ae04-1fb957fec521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc358b9-e1b8-4c94-b107-e7bc0b5cc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc358b9-e1b8-4c94-b107-e7bc0b5cc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9e4a3b0-29fc-455a-bc1f-465d53435c77', 'volume_name': 'volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77', 'volume_size': 1, 'snapshot_id': '05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e5ad35-587d-4ede-b6af-00df80e9d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e5ad35-587d-4ede-b6af-00df80e9d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36a0546-ec06-4105-8348-fb80333ee832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:09 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Volume d9e4a3b0-29fc-455a-bc1f-465d53435c77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77', 'volume_size': 1, 'snapshot_id': '05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5'} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-d9e4a3b0-29fc-455a-bc1f-465d53435c77" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-d9e4a3b0-29fc-455a-bc1f-465d53435c77" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Creating volume d9e4a3b0-29fc-455a-bc1f-465d53435c77 from snapshot 05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] snapshot: 05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5, volume: d9e4a3b0-29fc-455a-bc1f-465d53435c77, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2714d-a9f7-4cde-9dfa-5bafa87419d3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:09 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:33:09 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:09 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.500s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e51e39-c1ca-44b0-a4ba-8f5b9d541d3e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:09 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:33:09 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:10 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:33:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:33:10 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:33:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:10 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 Aug 28 16:33:10 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Flow 'volume_create_manager' (825673ee-6df7-4d51-bea8-761488d4818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc55abc-ccfb-4ed1-816b-74be04da8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc55abc-ccfb-4ed1-816b-74be04da8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-95287614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd282c88-5c33-462f-8b76-5bedb0b333f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c906dc4c2c4ceaaa34c2f171070f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:33:17Z,use_quota=True,user_id='558a47f5417740e1bdf61d914c736678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef49650-1e3f-4728-8af6-435c92177102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef49650-1e3f-4728-8af6-435c92177102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2a153-a322-4604-bf1e-ea0f51af1e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2a153-a322-4604-bf1e-ea0f51af1e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd282c88-5c33-462f-8b76-5bedb0b333f6', 'volume_name': 'volume-dd282c88-5c33-462f-8b76-5bedb0b333f6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd3536-bbcb-4a93-9c7e-6d135f3ab5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdd3536-bbcb-4a93-9c7e-6d135f3ab5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbbedd-8fa6-4cd5-beeb-ec795e941085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:17 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Volume dd282c88-5c33-462f-8b76-5bedb0b333f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd282c88-5c33-462f-8b76-5bedb0b333f6', 'volume_size': 1} Aug 28 16:33:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:18 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77" returned: 0 in 8.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:33:18 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Converted 1024.00 MB image at 123.96 MB/s Aug 28 16:33:18 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 is being set with open permissions: ugo+rw Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:18 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 Aug 28 16:33:18 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:18 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77" returned: 0 in 0.396s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" released by "_copy_volume_from_snapshot" :: held 9.730s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-d9e4a3b0-29fc-455a-bc1f-465d53435c77" released by "_create_volume_from_snapshot" :: held 9.841s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.865s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-95287614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd282c88-5c33-462f-8b76-5bedb0b333f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8c906dc4c2c4ceaaa34c2f171070f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:33:17Z,use_quota=True,user_id='558a47f5417740e1bdf61d914c736678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Creating volume dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:33:18 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:33:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:19 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 1073741824 Aug 28 16:33:19 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36a0546-ec06-4105-8348-fb80333ee832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77', 'volume_size': 1, 'snapshot_id': '05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32517aaf-e9f1-475e-bfc1-25c403f42b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:19 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Volume volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 (d9e4a3b0-29fc-455a-bc1f-465d53435c77): created successfully Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32517aaf-e9f1-475e-bfc1-25c403f42b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Flow 'volume_create_manager' (9224df3a-e9d0-41f9-ba9c-1c60888cc860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:33:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d84326f0-cb82-414e-81e3-7391829f1caa tempest-TestStampPattern-1400269941 None] Created volume successfully. Aug 28 16:33:19 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 1073741824" returned: 0 in 0.597s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:19 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:19 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:19 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bbbedd-8fa6-4cd5-beeb-ec795e941085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd282c88-5c33-462f-8b76-5bedb0b333f6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d017b0-168e-4b2b-a0e1-8180c3c846cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:33:20 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Volume volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 (dd282c88-5c33-462f-8b76-5bedb0b333f6): created successfully Aug 28 16:33:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d017b0-168e-4b2b-a0e1-8180c3c846cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:33:20 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Flow 'volume_create_manager' (825673ee-6df7-4d51-bea8-761488d4818e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:33:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-796b82be-cb8f-4f03-bd5a-eb1fec1f67a9 tempest-TestImageHashVerification-1231685002 None] Created volume successfully. Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6bc964-8188-4a59-9bfe-19805372e09f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:22 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:22 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:22 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.481s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae5f0af-ee71-487d-82d3-6fd34fd3c436]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:23 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:23 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:23 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.431s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 /opt/stack/data/cinder/conversion/dd282c88-5c33-462f-8b76-5bedb0b333f6.temp_image.f7891519-1263-46e7-90c9-189a4c91d682q9vry7lp.img {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:23 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 /opt/stack/data/cinder/conversion/dd282c88-5c33-462f-8b76-5bedb0b333f6.temp_image.f7891519-1263-46e7-90c9-189a4c91d682q9vry7lp.img Aug 28 16:33:23 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:29 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 /opt/stack/data/cinder/conversion/dd282c88-5c33-462f-8b76-5bedb0b333f6.temp_image.f7891519-1263-46e7-90c9-189a4c91d682q9vry7lp.img" returned: 0 in 6.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8e0a8-9ece-446b-8bc0-237886a2af4d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:29 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:29 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:30 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:33:30 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.551s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:30 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/conversion/dd282c88-5c33-462f-8b76-5bedb0b333f6.temp_image.f7891519-1263-46e7-90c9-189a4c91d682q9vry7lp.img {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:33:30 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Converted 1024.00 MB image at 161.03 MB/s Aug 28 16:33:30 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] f7891519-1263-46e7-90c9-189a4c91d682 was raw, no need to convert to raw {{(pid=86193) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:31 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:33:31 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:31 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.289s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:33:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:33:40 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:33:40 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:33:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.762s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:49 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Uploaded volume to glance image-id: f7891519-1263-46e7-90c9-189a4c91d682. {{(pid=86193) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 16:33:49 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b4551015-f163-4d5e-9e0d-e6423ee060f5 tempest-TestImageHashVerification-1231685002 None] Copy volume to image completed successfully. Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "cinder-dd282c88-5c33-462f-8b76-5bedb0b333f6-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "cinder-dd282c88-5c33-462f-8b76-5bedb0b333f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "cinder-quobyte-dd282c88-5c33-462f-8b76-5bedb0b333f6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "cinder-quobyte-dd282c88-5c33-462f-8b76-5bedb0b333f6" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47463e-383b-465d-a3eb-f67c6fd7a56c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:50 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:50 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-197df5c4-fe4f-4687-a510-795e7801a338 req-e885ead4-8d9b-463a-a038-53512cec2209 tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-197df5c4-fe4f-4687-a510-795e7801a338 req-e885ead4-8d9b-463a-a038-53512cec2209 tempest-TestStampPattern-1400269941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [req-197df5c4-fe4f-4687-a510-795e7801a338 req-e885ead4-8d9b-463a-a038-53512cec2209 tempest-TestStampPattern-1400269941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:50 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.398s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:50 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6 Aug 28 16:33:50 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:50 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-197df5c4-fe4f-4687-a510-795e7801a338 req-e885ead4-8d9b-463a-a038-53512cec2209 tempest-TestStampPattern-1400269941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa', 'name': 'volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aef6c78-f074-4930-9417-8163c77e88a9', 'enforce_multipath': True} {{(pid=86193) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 16:33:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-197df5c4-fe4f-4687-a510-795e7801a338 req-e885ead4-8d9b-463a-a038-53512cec2209 tempest-TestStampPattern-1400269941 None] attachment_update completed successfully. Aug 28 16:33:51 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-dd282c88-5c33-462f-8b76-5bedb0b333f6" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "cinder-quobyte-dd282c88-5c33-462f-8b76-5bedb0b333f6" released by "delete_volume" :: held 0.702s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Created reservations ['44928584-2b2f-4b71-9453-d677bad97ea9', '22c8cbc3-5647-44f6-a1e8-70fba09b5d5b', 'a31e89d5-303e-4272-988a-5fd672ffb69f', 'bed08eab-c12b-4f8a-9339-82b0bdabe34b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:33:51 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:33:51 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:33:51 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:33:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Deleted volume successfully. Aug 28 16:33:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9c3cf8cc-b2da-47e8-a1c9-e08d61697c47 tempest-TestImageHashVerification-1231685002 None] Lock "cinder-dd282c88-5c33-462f-8b76-5bedb0b333f6-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:33:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [req-2e478c77-4011-4315-99e9-bef70fd91f84 req-f2f09f3f-38a1-4c39-94d9-0cc86e120a05 tempest-TestStampPattern-1400269941 None] Terminate volume connection completed successfully. Aug 28 16:33:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [req-2e478c77-4011-4315-99e9-bef70fd91f84 req-f2f09f3f-38a1-4c39-94d9-0cc86e120a05 tempest-TestStampPattern-1400269941 None] Deleting attachment 8aef6c78-f074-4930-9417-8163c77e88a9. {{(pid=86193) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-d9e4a3b0-29fc-455a-bc1f-465d53435c77-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "cinder-d9e4a3b0-29fc-455a-bc1f-465d53435c77-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6cb4b-3525-4c1a-8a12-040e7c05a5e5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:33:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:00 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 Aug 28 16:34:00 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:00 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77" returned: 0 in 0.398s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:00 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77 Aug 28 16:34:00 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:00 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d9e4a3b0-29fc-455a-bc1f-465d53435c77" returned: 0 in 0.336s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-d9e4a3b0-29fc-455a-bc1f-465d53435c77" released by "delete_volume" :: held 0.783s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Created reservations ['a7596bd7-b5a9-4391-b03c-de1e55913a5f', '9b7122fc-6db6-4253-ae0b-164be8761a86', 'f2169410-a4fb-4923-8b71-a811f696fff9', '9803ee02-4811-4fc1-b6ce-413fc537b778'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:00 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:00 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:01 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Deleted volume successfully. Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a45d90c6-5424-40eb-bf01-399601197d25 tempest-TestStampPattern-1400269941 None] Lock "cinder-d9e4a3b0-29fc-455a-bc1f-465d53435c77-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Deleting offline snapshot 05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 of volume c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] snapshot_file for this snap is: volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb9a0e6-0dd2-4f2b-8678-23c6f70a1095]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:01 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:34:01 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:01 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece9adb-52f2-4c6d-bbc5-67026d27ed96]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:02 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:34:02 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:02 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.588s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:02 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:34:02 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:02 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:02 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5 Aug 28 16:34:02 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:03 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2.05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" returned: 0 in 0.287s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5" released by "_delete_snapshot" :: held 1.808s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" released by "delete_snapshot" :: held 1.836s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:03 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Created reservations ['c5460a6e-736d-4541-b08c-8e95aaa78a2d', '79d68c19-e18f-4846-b08f-e6a2ded4e103', 'a2f89000-689b-4167-9d9b-1b4610f3d468', '0d470077-f583-4c19-9c9d-d1878c72d8f3'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Delete snapshot completed successfully. Aug 28 16:34:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04ac6ed2-1e2a-4f40-9125-5f9bd3f02f84 tempest-TestStampPattern-1400269941 None] Lock "cinder-05cfdf85-9a06-4b7f-b9b0-3e4d6d1652e5-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "cinder-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Acquiring lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f49ec3-6cbf-402b-9e7b-af564f730d91]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:07 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:34:07 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:07 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.417s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:08 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2 Aug 28 16:34:08 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Flow 'volume_create_manager' (5789d9a2-ab9b-4663-94a2-0ee2795de6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d888f608-ff3c-4270-8975-9c1e9d8c5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d888f608-ff3c-4270-8975-9c1e9d8c5572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf76d2-673b-4ade-a7dd-88855ce2b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea35b1ca67f4483ab624bc14747d3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:08Z,use_quota=True,user_id='ac7323ceb3194b7eb621d578f4315ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c0fd8c-43d1-44cc-8bbd-f7e8f39933f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c0fd8c-43d1-44cc-8bbd-f7e8f39933f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:08 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ae1451-d228-4333-af68-f1655382132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" returned: 0 in 0.277s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "cinder-quobyte-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2" released by "delete_volume" :: held 0.762s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Created reservations ['9c29cf86-554d-4896-94cf-1e0626d72a90', '38fb513c-28af-4c3c-a91d-557dd201e13c', 'c1bfd5cd-7223-476e-b4b0-b66d8b186ce0', '7d9c885c-e801-4dbf-95dd-800bca798e3f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:08 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:08 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ae1451-d228-4333-af68-f1655382132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bcf76d2-673b-4ade-a7dd-88855ce2b2fa', 'volume_name': 'volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa', 'volume_size': 1, 'image_id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bab57c3f06e21aecb2dde5f8c15cebe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea35b1ca67f4483ab624bc14747d3fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db3a14d961dc0796264b7181bbc93621f3339f5ae044ca101def867f73f74284b8c5ad34bd39a3329f76e451357fbc4942c1be667a28f0506358b8c9819eaa88', 'id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd49526-d82d-4be9-ba24-6ec7760f418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd49526-d82d-4be9-ba24-6ec7760f418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9cae2e-3e25-4c57-b4d7-1d4198e38ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa', 'volume_size': 1, 'image_id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bab57c3f06e21aecb2dde5f8c15cebe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea35b1ca67f4483ab624bc14747d3fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db3a14d961dc0796264b7181bbc93621f3339f5ae044ca101def867f73f74284b8c5ad34bd39a3329f76e451357fbc4942c1be667a28f0506358b8c9819eaa88', 'id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5/file', 'properties': {}}, 'image_service': } Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Trying to clone 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa from image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:34:08 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Image download 0.00 MB at 0.00 MB/s Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0fc8ba-7f2a-423c-91e1-039e32a0422e]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:08 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:08 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Deleted volume successfully. Aug 28 16:34:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-aaeac5fe-c4ed-453c-ae29-3051dcfefc8a tempest-TestStampPattern-1400269941 None] Lock "cinder-c3a7677f-d545-4c3e-afb3-7e3bbde8e5f2-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:08 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:08 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:09 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:09 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:09 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:09 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Temporary image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 is fetched for user ac7323ceb3194b7eb621d578f4315ccc. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d5cdf-5ef7-43b8-a45c-c3a0c4a576e6]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:09 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:09 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:09 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:09 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:09 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:10 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf76d2-673b-4ade-a7dd-88855ce2b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea35b1ca67f4483ab624bc14747d3fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:08Z,use_quota=True,user_id='ac7323ceb3194b7eb621d578f4315ccc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Creating volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:10 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:10 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1073741824 Aug 28 16:34:10 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:10 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1073741824" returned: 0 in 0.441s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:10 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa Aug 28 16:34:10 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:11 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" returned: 0 in 0.294s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Attempting download of c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}])) to volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126ff57-c847-45ff-8378-ff9eb93d2c58]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:11 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc Aug 28 16:34:11 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:11 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:11 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc Aug 28 16:34:11 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:11 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc" returned: 1 in 0.383s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_pesq53gc' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3039019-7e72-4d77-949d-33b43faadef6]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:12 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:12 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:12 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:12 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD Aug 28 16:34:12 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:12 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 was raw, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:34:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:12 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa Aug 28 16:34:12 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:13 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" returned: 0 in 0.671s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0dc0fc5-7378-4025-ac84-61fd8b8caaf5_7imo91opdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:34:13 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:13 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1G Aug 28 16:34:13 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:13 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa 1G" returned: 0 in 0.360s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Downloaded image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}])) to volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Temporary image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 for user ac7323ceb3194b7eb621d578f4315ccc is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Marking volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Copying metadata from image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 to 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Creating volume glance metadata for volume 9bcf76d2-673b-4ade-a7dd-88855ce2b2fa backed by image c0dc0fc5-7378-4025-ac84-61fd8b8caaf5 with: {'image_id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bab57c3f06e21aecb2dde5f8c15cebe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9cae2e-3e25-4c57-b4d7-1d4198e38ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa', 'volume_size': 1, 'image_id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bab57c3f06e21aecb2dde5f8c15cebe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cea35b1ca67f4483ab624bc14747d3fd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'db3a14d961dc0796264b7181bbc93621f3339f5ae044ca101def867f73f74284b8c5ad34bd39a3329f76e451357fbc4942c1be667a28f0506358b8c9819eaa88', 'id': 'c0dc0fc5-7378-4025-ac84-61fd8b8caaf5', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc0fc5-7378-4025-ac84-61fd8b8caaf5/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bf2551-e9f8-4e2c-888e-537ccc46fafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:13 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Volume volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa (9bcf76d2-673b-4ade-a7dd-88855ce2b2fa): created successfully Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bf2551-e9f8-4e2c-888e-537ccc46fafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Flow 'volume_create_manager' (5789d9a2-ab9b-4663-94a2-0ee2795de6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-933cbf6a-f862-47dd-bef9-d6f1a5e68e93 tempest-VolumeImageDependencyTests-1140395421 None] Created volume successfully. Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Acquiring lock "cinder-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "cinder-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Acquiring lock "cinder-quobyte-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "cinder-quobyte-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4fdff-a4a0-4249-b93b-be6290e55dd0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:14 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa Aug 28 16:34:14 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:15 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" returned: 0 in 0.445s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:15 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa Aug 28 16:34:15 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:15 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" returned: 0 in 0.277s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "cinder-quobyte-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa" released by "delete_volume" :: held 0.770s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Created reservations ['5022ec22-0c8a-4235-92bc-49b03510e7d6', 'fb6f4a37-d939-429d-b2c4-28b5da804d7b', 'bca801dc-6268-4487-94f9-10bd43fea420', '9da851ce-f6f5-4191-bccd-b059b0e2c84f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:15 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:15 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:15 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:15 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Deleted volume successfully. Aug 28 16:34:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e42aa397-302d-44d8-bb7e-742a54535eeb tempest-VolumeImageDependencyTests-1140395421 None] Lock "cinder-9bcf76d2-673b-4ade-a7dd-88855ce2b2fa-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (e3013388-8e6a-4677-b0ca-4b78da9d9142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904ac926-b9a3-4aec-a16f-1f876c1ff58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904ac926-b9a3-4aec-a16f-1f876c1ff58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712405778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bf2e70-e9a7-440d-897b-5daee88a027d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:25Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd34c53e-121a-4752-9d05-05b048691cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd34c53e-121a-4752-9d05-05b048691cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648f01a8-40ca-4d97-bb49-292521372047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648f01a8-40ca-4d97-bb49-292521372047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bf2e70-e9a7-440d-897b-5daee88a027d', 'volume_name': 'volume-75bf2e70-e9a7-440d-897b-5daee88a027d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83916906-c323-4bec-8bda-a72e378c6385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83916906-c323-4bec-8bda-a72e378c6385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df3f188-f39e-460e-9beb-7504f77b7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Volume 75bf2e70-e9a7-440d-897b-5daee88a027d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bf2e70-e9a7-440d-897b-5daee88a027d', 'volume_size': 1} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712405778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bf2e70-e9a7-440d-897b-5daee88a027d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:25Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Creating volume 75bf2e70-e9a7-440d-897b-5daee88a027d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:25 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:25 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d 1073741824 Aug 28 16:34:25 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:26 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d 1073741824" returned: 0 in 0.559s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:26 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d Aug 28 16:34:26 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:26 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df3f188-f39e-460e-9beb-7504f77b7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bf2e70-e9a7-440d-897b-5daee88a027d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a35b03f-fc52-4843-9a52-0a32f57d0883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Volume volume-75bf2e70-e9a7-440d-897b-5daee88a027d (75bf2e70-e9a7-440d-897b-5daee88a027d): created successfully Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a35b03f-fc52-4843-9a52-0a32f57d0883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (e3013388-8e6a-4677-b0ca-4b78da9d9142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-24c0f553-e3bb-4ef3-bc2e-4d35ab769cc1 tempest-ProjectReaderTests-187705565 None] Created volume successfully. Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Flow 'volume_create_manager' (3828c17f-e7ed-4a27-9cf5-637b761b9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e406655-b69d-43c2-8e22-4d69fdab630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e406655-b69d-43c2-8e22-4d69fdab630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2929c055-cfa8-4913-9c59-87ebd09b1c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09eb78b249224b81b4c75d5eb66b70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:27Z,use_quota=True,user_id='f27b0c3e091d409d869c33bf59affe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a3edadf-7006-4c54-86dd-b63e78a4184f),volume_type_id=3a3edadf-7006-4c54-86dd-b63e78a4184f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09f571a-de3e-4a5c-8d38-03499aad3b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09f571a-de3e-4a5c-8d38-03499aad3b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789da19-78f9-4c60-acf0-7366b78a7765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789da19-78f9-4c60-acf0-7366b78a7765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2929c055-cfa8-4913-9c59-87ebd09b1c23', 'volume_name': 'volume-2929c055-cfa8-4913-9c59-87ebd09b1c23', 'volume_size': 1, 'image_id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7f7262ddf72742e566f548c9f891d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09eb78b249224b81b4c75d5eb66b70ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7c6c0d874a4cf18d318f9f89c59a6d1e1184a5c5e0f38c2ca76c9fbb2f12cd01e0874ae40e3b64fdca993c22559a00d3600ab576a8f1aac81cd2b2f6909edbe', 'id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b304342-3b4f-4157-8d07-3ffd2730348f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f12640e-927a-4c66-abe3-d62f4beb6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f12640e-927a-4c66-abe3-d62f4beb6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f566510f-c5d6-4cf2-a32b-1e3949ad19cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Volume 2929c055-cfa8-4913-9c59-87ebd09b1c23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2929c055-cfa8-4913-9c59-87ebd09b1c23', 'volume_size': 1, 'image_id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7f7262ddf72742e566f548c9f891d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09eb78b249224b81b4c75d5eb66b70ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7c6c0d874a4cf18d318f9f89c59a6d1e1184a5c5e0f38c2ca76c9fbb2f12cd01e0874ae40e3b64fdca993c22559a00d3600ab576a8f1aac81cd2b2f6909edbe', 'id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b304342-3b4f-4157-8d07-3ffd2730348f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Trying to clone 2929c055-cfa8-4913-9c59-87ebd09b1c23 from image 1b304342-3b4f-4157-8d07-3ffd2730348f at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:34:27 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Image download 0.00 MB at 0.00 MB/s Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60dc04-86c1-4023-adc1-28581616f56e]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-75bf2e70-e9a7-440d-897b-5daee88a027d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "cinder-75bf2e70-e9a7-440d-897b-5daee88a027d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:27 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:27 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-quobyte-75bf2e70-e9a7-440d-897b-5daee88a027d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-75bf2e70-e9a7-440d-897b-5daee88a027d" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a601b-141e-417a-9358-69f8d5946767]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:28 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d Aug 28 16:34:28 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:28 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:28 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:28 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:28 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d" returned: 0 in 0.408s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:28 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d Aug 28 16:34:28 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:28 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Temporary image 1b304342-3b4f-4157-8d07-3ffd2730348f is fetched for user f27b0c3e091d409d869c33bf59affe21. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[06091d6c-6f5a-4070-9db0-db21f9fdc5f9]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:28 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-75bf2e70-e9a7-440d-897b-5daee88a027d" returned: 0 in 0.283s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-75bf2e70-e9a7-440d-897b-5daee88a027d" released by "delete_volume" :: held 0.741s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:28 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:28 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Created reservations ['c0228aea-2bb1-43a9-9f10-68c46174946d', '0453417f-aec8-4b2e-bffc-304894bc93c6', 'f165b47a-4f6f-4666-a34f-a39dfc857901', 'fd930e7d-beca-4988-9a28-8beee3bbc20a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:28 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:28 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:28 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:29 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:29 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:29 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Deleted volume successfully. Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a9b3fc9a-eb13-43a9-b8e7-9ac08e459a9d tempest-ProjectReaderTests-187705565 None] Lock "cinder-75bf2e70-e9a7-440d-897b-5daee88a027d-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:29 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2929c055-cfa8-4913-9c59-87ebd09b1c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09eb78b249224b81b4c75d5eb66b70ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:27Z,use_quota=True,user_id='f27b0c3e091d409d869c33bf59affe21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a3edadf-7006-4c54-86dd-b63e78a4184f),volume_type_id=3a3edadf-7006-4c54-86dd-b63e78a4184f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Creating volume 2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:29 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:29 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1073741824 Aug 28 16:34:29 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (a679954d-1230-4bdf-a33a-0aaf2d4efa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31482b77-712f-4a78-8df0-9b0a9b485532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31482b77-712f-4a78-8df0-9b0a9b485532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935240516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c02953d-f94f-408c-9432-f67806405cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:29Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689efdfd-1e00-45bb-b9ca-88633eb8e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689efdfd-1e00-45bb-b9ca-88633eb8e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c305a2b-3e04-49c4-83ec-f33fa58c123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c305a2b-3e04-49c4-83ec-f33fa58c123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c02953d-f94f-408c-9432-f67806405cdd', 'volume_name': 'volume-9c02953d-f94f-408c-9432-f67806405cdd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21030d3b-2fe1-4822-b477-7fb525220a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21030d3b-2fe1-4822-b477-7fb525220a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cafed6b-d2e9-4e32-a50a-595ef3c98005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Volume 9c02953d-f94f-408c-9432-f67806405cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c02953d-f94f-408c-9432-f67806405cdd', 'volume_size': 1} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:29 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1073741824" returned: 0 in 0.482s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:29 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 Aug 28 16:34:29 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:30 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23" returned: 0 in 0.270s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935240516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c02953d-f94f-408c-9432-f67806405cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:29Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Creating volume 9c02953d-f94f-408c-9432-f67806405cdd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:30 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Attempting download of 1b304342-3b4f-4157-8d07-3ffd2730348f ((None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}])) to volume 2929c055-cfa8-4913-9c59-87ebd09b1c23. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:34:30 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd 1073741824 Aug 28 16:34:30 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f676c810-64ac-46ed-87b3-740e2eef268f]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:30 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1 Aug 28 16:34:30 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:30 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd 1073741824" returned: 0 in 0.487s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:30 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:30 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd Aug 28 16:34:30 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:30 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1 Aug 28 16:34:30 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:31 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd" returned: 0 in 0.270s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cafed6b-d2e9-4e32-a50a-595ef3c98005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c02953d-f94f-408c-9432-f67806405cdd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edc56e6-8c4a-4534-bb1a-178a31a18987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:31 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Volume volume-9c02953d-f94f-408c-9432-f67806405cdd (9c02953d-f94f-408c-9432-f67806405cdd): created successfully Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edc56e6-8c4a-4534-bb1a-178a31a18987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (a679954d-1230-4bdf-a33a-0aaf2d4efa19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-95599e72-0d7d-4dec-a895-25f737230b9a tempest-ProjectReaderTests-187705565 None] Created volume successfully. Aug 28 16:34:31 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1" returned: 1 in 0.410s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b304342-3b4f-4157-8d07-3ffd2730348f_hdij7ib1' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0288c5-2b82-46cd-87c5-f5448ce0188e]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:31 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:31 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:31 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:31 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:31 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:31 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD Aug 28 16:34:31 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-9c02953d-f94f-408c-9432-f67806405cdd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "cinder-9c02953d-f94f-408c-9432-f67806405cdd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-quobyte-9c02953d-f94f-408c-9432-f67806405cdd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-9c02953d-f94f-408c-9432-f67806405cdd" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:31 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[057da319-78b1-49c0-99ec-9adba05b2c84]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:31 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] 1b304342-3b4f-4157-8d07-3ffd2730348f was raw, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:34:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:31 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 Aug 28 16:34:31 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:31 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd Aug 28 16:34:31 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:32 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:32 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd Aug 28 16:34:32 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:32 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23" returned: 0 in 0.468s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b304342-3b4f-4157-8d07-3ffd2730348f_zt8__5sedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:34:32 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:32 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1G Aug 28 16:34:32 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:32 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c02953d-f94f-408c-9432-f67806405cdd" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-9c02953d-f94f-408c-9432-f67806405cdd" released by "delete_volume" :: held 0.769s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Created reservations ['976e1b09-2d9c-4186-95ce-b003224c1592', 'fce725df-57fb-4e34-952c-a3696dd458a9', '5b90ad35-aad8-442f-aa3c-e8ed568e2f66', '7ad2814b-4ea5-425a-abc4-26e6828f310d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:32 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:32 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:32 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 1G" returned: 0 in 0.370s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Downloaded image 1b304342-3b4f-4157-8d07-3ffd2730348f ((None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}])) to volume 2929c055-cfa8-4913-9c59-87ebd09b1c23 successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Temporary image 1b304342-3b4f-4157-8d07-3ffd2730348f for user f27b0c3e091d409d869c33bf59affe21 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Marking volume 2929c055-cfa8-4913-9c59-87ebd09b1c23 as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Copying metadata from image 1b304342-3b4f-4157-8d07-3ffd2730348f to 2929c055-cfa8-4913-9c59-87ebd09b1c23. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Creating volume glance metadata for volume 2929c055-cfa8-4913-9c59-87ebd09b1c23 backed by image 1b304342-3b4f-4157-8d07-3ffd2730348f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c7f7262ddf72742e566f548c9f891d8b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f566510f-c5d6-4cf2-a32b-1e3949ad19cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2929c055-cfa8-4913-9c59-87ebd09b1c23', 'volume_size': 1, 'image_id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b304342-3b4f-4157-8d07-3ffd2730348f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7f7262ddf72742e566f548c9f891d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09eb78b249224b81b4c75d5eb66b70ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7c6c0d874a4cf18d318f9f89c59a6d1e1184a5c5e0f38c2ca76c9fbb2f12cd01e0874ae40e3b64fdca993c22559a00d3600ab576a8f1aac81cd2b2f6909edbe', 'id': '1b304342-3b4f-4157-8d07-3ffd2730348f', 'created_at': datetime.datetime(2026, 8, 28, 14, 34, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 34, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b304342-3b4f-4157-8d07-3ffd2730348f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c767112-23f0-4afb-8255-0fab4a290ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:32 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Volume volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 (2929c055-cfa8-4913-9c59-87ebd09b1c23): created successfully Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c767112-23f0-4afb-8255-0fab4a290ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Flow 'volume_create_manager' (3828c17f-e7ed-4a27-9cf5-637b761b9763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3f54f365-e9ba-47cd-b96a-a45c6d319797 tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Created volume successfully. Aug 28 16:34:32 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Deleted volume successfully. Aug 28 16:34:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5e930a2-a873-4e1a-8105-916d7169fe8d tempest-ProjectReaderTests-187705565 None] Lock "cinder-9c02953d-f94f-408c-9432-f67806405cdd-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (3e8f0680-e195-42f0-8d8a-f81bda70d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cfdf24-1912-4a2d-b2f1-4e78d89db7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cfdf24-1912-4a2d-b2f1-4e78d89db7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639368145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410db4f9-5080-4652-889e-3811fa7f55f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:33Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a89c28b-a7f5-44f8-b8d7-df0d0e9a32c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a89c28b-a7f5-44f8-b8d7-df0d0e9a32c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe3882f-e20b-4301-a1f1-1d46c889ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe3882f-e20b-4301-a1f1-1d46c889ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410db4f9-5080-4652-889e-3811fa7f55f3', 'volume_name': 'volume-410db4f9-5080-4652-889e-3811fa7f55f3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cfa777-6ae5-4c38-b721-7542a6b37796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cfa777-6ae5-4c38-b721-7542a6b37796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a516099-e5d7-4ab2-a570-5b647316b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:33 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Volume 410db4f9-5080-4652-889e-3811fa7f55f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410db4f9-5080-4652-889e-3811fa7f55f3', 'volume_size': 1} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639368145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410db4f9-5080-4652-889e-3811fa7f55f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:33Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Creating volume 410db4f9-5080-4652-889e-3811fa7f55f3 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:33 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:33 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 1073741824 Aug 28 16:34:33 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Acquiring lock "cinder-2929c055-cfa8-4913-9c59-87ebd09b1c23-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "cinder-2929c055-cfa8-4913-9c59-87ebd09b1c23-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Acquiring lock "cinder-quobyte-2929c055-cfa8-4913-9c59-87ebd09b1c23" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "cinder-quobyte-2929c055-cfa8-4913-9c59-87ebd09b1c23" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[590fe2c8-e37a-44fd-8b4d-a70b01fff47e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:33 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 1073741824" returned: 0 in 0.454s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:33 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 Aug 28 16:34:33 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:33 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 Aug 28 16:34:33 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:34 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a516099-e5d7-4ab2-a570-5b647316b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410db4f9-5080-4652-889e-3811fa7f55f3', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f50eb-d319-4ea1-82b9-f09535076f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:34 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Volume volume-410db4f9-5080-4652-889e-3811fa7f55f3 (410db4f9-5080-4652-889e-3811fa7f55f3): created successfully Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f50eb-d319-4ea1-82b9-f09535076f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (3e8f0680-e195-42f0-8d8a-f81bda70d31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:34 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23" returned: 0 in 0.390s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2246dbb5-660e-4b70-9b18-2fbee651cdae tempest-ProjectReaderTests-187705565 None] Created volume successfully. Aug 28 16:34:34 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23 Aug 28 16:34:34 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-410db4f9-5080-4652-889e-3811fa7f55f3-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "cinder-410db4f9-5080-4652-889e-3811fa7f55f3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-quobyte-410db4f9-5080-4652-889e-3811fa7f55f3" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-410db4f9-5080-4652-889e-3811fa7f55f3" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8962ccd-0731-4e8f-96af-5811ae52a9a6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:34 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2929c055-cfa8-4913-9c59-87ebd09b1c23" returned: 0 in 0.312s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "cinder-quobyte-2929c055-cfa8-4913-9c59-87ebd09b1c23" released by "delete_volume" :: held 0.745s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:34 devstack cinder-volume[86193]: WARNING cinder.quota [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:34:34 devstack cinder-volume[86193]: WARNING cinder.quota [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Created reservations ['0d805aaa-0443-4953-827b-0c21b1ad2e94', 'e109c428-b2c0-4e8c-897b-05b09508bd45', '2d90b0f6-fb96-4e8b-b7f0-cdd4617d9ad4', '1d4b7437-8881-4028-b079-8839e2cdbd15'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:34 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 Aug 28 16:34:34 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:34 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:34 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:34 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3" returned: 0 in 0.421s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:34 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.276s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Deleted volume successfully. Aug 28 16:34:34 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3 Aug 28 16:34:34 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-004258a3-16bc-4fec-bfcd-8df869c1afbb tempest-VolumeAndVolumeTypeFromImageTest-842070789 None] Lock "cinder-2929c055-cfa8-4913-9c59-87ebd09b1c23-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:35 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-410db4f9-5080-4652-889e-3811fa7f55f3" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-410db4f9-5080-4652-889e-3811fa7f55f3" released by "delete_volume" :: held 0.779s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Created reservations ['367fe3e7-e97d-4850-99fb-9715288766fa', 'f18e6427-f0f2-4984-9e32-2ff12ec3705a', 'e7ddfbdf-c1d6-47f9-a6f2-64c42f533361', '60c945c3-a76d-45bb-9355-f83af536a1eb'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:35 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:35 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:35 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Deleted volume successfully. Aug 28 16:34:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6a078225-d5a6-4901-bd90-49e0347bee68 tempest-ProjectReaderTests-187705565 None] Lock "cinder-410db4f9-5080-4652-889e-3811fa7f55f3-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (7f9083f6-1f17-447f-a0f1-cefa7eee0812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857995e2-9a10-4c19-b8cc-b094b70bd415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857995e2-9a10-4c19-b8cc-b094b70bd415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773223419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66de4e5-9a40-40b2-b119-6eba70a4a51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:36Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b719c1-199f-4840-bc8f-9b8302e576e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b719c1-199f-4840-bc8f-9b8302e576e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51650d4d-4ca6-4a90-9126-233c15a32b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51650d4d-4ca6-4a90-9126-233c15a32b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66de4e5-9a40-40b2-b119-6eba70a4a51e', 'volume_name': 'volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3955e01e-4a27-4fe3-b35d-58b21c21d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3955e01e-4a27-4fe3-b35d-58b21c21d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2b0b2e-8c33-442a-bd7a-0eab6b1aeb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Volume c66de4e5-9a40-40b2-b119-6eba70a4a51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e', 'volume_size': 1} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773223419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66de4e5-9a40-40b2-b119-6eba70a4a51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6b8d414b574adda8aaf49202b6bbf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:36Z,use_quota=True,user_id='b8d59131e9924666b0f7cb30ed0db297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Creating volume c66de4e5-9a40-40b2-b119-6eba70a4a51e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:36 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:36 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e 1073741824 Aug 28 16:34:36 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:36 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e 1073741824" returned: 0 in 0.471s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:36 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e Aug 28 16:34:36 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:36 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e" returned: 0 in 0.265s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2b0b2e-8c33-442a-bd7a-0eab6b1aeb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e47766a-8b04-4aba-a600-9fe9c3daf011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Volume volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e (c66de4e5-9a40-40b2-b119-6eba70a4a51e): created successfully Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e47766a-8b04-4aba-a600-9fe9c3daf011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Flow 'volume_create_manager' (7f9083f6-1f17-447f-a0f1-cefa7eee0812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-92b0f5cc-a7b0-4dd8-b65d-d5cda417fec2 tempest-ProjectReaderTests-187705565 None] Created volume successfully. Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-c66de4e5-9a40-40b2-b119-6eba70a4a51e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "cinder-c66de4e5-9a40-40b2-b119-6eba70a4a51e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Acquiring lock "cinder-quobyte-c66de4e5-9a40-40b2-b119-6eba70a4a51e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-c66de4e5-9a40-40b2-b119-6eba70a4a51e" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b344f9c3-0e1d-4c11-b8bb-9a0480877fd9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:37 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e Aug 28 16:34:37 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:37 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e" returned: 0 in 0.431s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:37 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e Aug 28 16:34:37 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:38 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c66de4e5-9a40-40b2-b119-6eba70a4a51e" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "cinder-quobyte-c66de4e5-9a40-40b2-b119-6eba70a4a51e" released by "delete_volume" :: held 0.773s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Created reservations ['e1a224fe-9052-4d1f-adde-56fa788943b0', '5034419a-0a23-4045-9134-14725d330953', '6bdf28a1-e252-4942-a20d-804b1cf879b0', 'e67f1701-bdf3-4dc3-857a-674b0fb6efc6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:38 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:38 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:38 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.266s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Deleted volume successfully. Aug 28 16:34:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7ab14779-8c4e-4693-8c50-29295844500c tempest-ProjectReaderTests-187705565 None] Lock "cinder-c66de4e5-9a40-40b2-b119-6eba70a4a51e-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:39 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (087f42bd-33bc-4a42-b358-d1bddb786730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7b1524-0b4e-402c-a84f-013cbbf2b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7b1524-0b4e-402c-a84f-013cbbf2b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897641936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9603f8-6076-4054-995b-0fe04ab5ab55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:40Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6982ef-854a-4cc0-9e5b-5c8590eb0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6982ef-854a-4cc0-9e5b-5c8590eb0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32adbbd9-ab06-4531-aace-d9788f17c488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32adbbd9-ab06-4531-aace-d9788f17c488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9603f8-6076-4054-995b-0fe04ab5ab55', 'volume_name': 'volume-bf9603f8-6076-4054-995b-0fe04ab5ab55', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95f5aa0-7ac7-4c7b-9ef3-87f5197a713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95f5aa0-7ac7-4c7b-9ef3-87f5197a713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a8b0cf-3cd8-4453-b29a-35e58f2ab93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume bf9603f8-6076-4054-995b-0fe04ab5ab55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9603f8-6076-4054-995b-0fe04ab5ab55', 'volume_size': 1} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-897641936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9603f8-6076-4054-995b-0fe04ab5ab55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:40Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:40 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:40 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 1073741824 Aug 28 16:34:40 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:40 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 1073741824" returned: 0 in 0.439s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=103,cinder:SELECT=89,cinder:INSERT=29,cinder:DELETE=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=78,cinder:UPDATE=100,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:40 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 Aug 28 16:34:40 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:40 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55" returned: 0 in 0.244s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a8b0cf-3cd8-4453-b29a-35e58f2ab93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9603f8-6076-4054-995b-0fe04ab5ab55', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aed9a49-9073-4ea5-852b-7dd93268ebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 (bf9603f8-6076-4054-995b-0fe04ab5ab55): created successfully Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aed9a49-9073-4ea5-852b-7dd93268ebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (087f42bd-33bc-4a42-b358-d1bddb786730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-78320358-7361-4b9d-9871-3692e6ab556e tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating offline snapshot 64433dce-cfc7-474e-98a5-893ed07ea5be of volume bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1a633-4b23-425e-8fe0-d6c0f2815e6c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:42 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 Aug 28 16:34:42 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:42 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55" returned: 0 in 0.380s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:42 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be 1G Aug 28 16:34:42 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:43 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be 1G" returned: 0 in 0.393s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:43 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be Aug 28 16:34:43 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:43 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:43 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be is being set with open permissions: ugo+rw Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:43 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be Aug 28 16:34:43 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:43 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be" returned: 0 in 0.263s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:43 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info Aug 28 16:34:43 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:43 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:43 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info is being set with open permissions: ugo+rw Aug 28 16:34:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:43 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info Aug 28 16:34:43 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:44 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.info" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c5ce9e00-83e2-4ac4-bedc-6e9254c0937a tempest-CreateVolumesFromSnapshotTest-714616348 None] Create snapshot completed successfully Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (482b9197-3bfd-4b63-989d-97bac148b432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07cc906-e108-43ad-bcc0-8fb4895609ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07cc906-e108-43ad-bcc0-8fb4895609ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007694094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb83af74-35ff-4daf-9c49-1cb538576c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21035629-cd18-4656-9f2f-361439d4e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21035629-cd18-4656-9f2f-361439d4e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed832ad-fc6c-4a0d-af32-a512f1a351f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed832ad-fc6c-4a0d-af32-a512f1a351f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb83af74-35ff-4daf-9c49-1cb538576c5d', 'volume_name': 'volume-fb83af74-35ff-4daf-9c49-1cb538576c5d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0337f7-c708-43b1-b4cf-85b9cf8ce08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0337f7-c708-43b1-b4cf-85b9cf8ce08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c32c927-2263-4098-a426-28ec5239b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:44 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume fb83af74-35ff-4daf-9c49-1cb538576c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb83af74-35ff-4daf-9c49-1cb538576c5d', 'volume_size': 1} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2007694094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb83af74-35ff-4daf-9c49-1cb538576c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume fb83af74-35ff-4daf-9c49-1cb538576c5d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:44 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:44 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d 1073741824 Aug 28 16:34:44 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (37c342f1-4b14-4186-ac04-496eaa3011ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918ea488-d411-45f6-a036-492c91367a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918ea488-d411-45f6-a036-492c91367a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691525285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b12a751-8c9c-4822-ada0-1736024b9dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969832b0-6319-4929-84f8-aaf0a4ec0545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969832b0-6319-4929-84f8-aaf0a4ec0545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7734987a-d5f5-4ff0-84d3-0ed9616f95b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7734987a-d5f5-4ff0-84d3-0ed9616f95b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b12a751-8c9c-4822-ada0-1736024b9dff', 'volume_name': 'volume-3b12a751-8c9c-4822-ada0-1736024b9dff', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2b4f0a-0ba8-4dad-864e-933a8e2e5cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2b4f0a-0ba8-4dad-864e-933a8e2e5cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f8b5c-826a-45a3-9aaf-2a3ca998af88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume 3b12a751-8c9c-4822-ada0-1736024b9dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b12a751-8c9c-4822-ada0-1736024b9dff', 'volume_size': 1} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:45 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d 1073741824" returned: 0 in 0.557s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:45 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d Aug 28 16:34:45 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (1671b48b-625c-458d-a6e6-0decfab8c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d9380f-4670-4ed2-bef5-8e71b52b0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d9380f-4670-4ed2-bef5-8e71b52b0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281589836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d524ed63-d42d-4a0d-afcb-c57139f7ac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34237abb-acae-4a19-adfb-e59b4e815bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34237abb-acae-4a19-adfb-e59b4e815bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b13a41a-3538-4540-81d9-aae6a1afcf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b13a41a-3538-4540-81d9-aae6a1afcf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd524ed63-d42d-4a0d-afcb-c57139f7ac41', 'volume_name': 'volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e804d79-71bb-4c3c-ba0d-753a0020906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e804d79-71bb-4c3c-ba0d-753a0020906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1182d085-9b38-4e8a-bb66-58fce06477c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume d524ed63-d42d-4a0d-afcb-c57139f7ac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41', 'volume_size': 1} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:45 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d" returned: 0 in 0.306s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691525285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b12a751-8c9c-4822-ada0-1736024b9dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume 3b12a751-8c9c-4822-ada0-1736024b9dff {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:45 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:45 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff 1073741824 Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c32c927-2263-4098-a426-28ec5239b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb83af74-35ff-4daf-9c49-1cb538576c5d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3baec50-58c3-43ad-bb1d-6d45f1cba9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-fb83af74-35ff-4daf-9c49-1cb538576c5d (fb83af74-35ff-4daf-9c49-1cb538576c5d): created successfully Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3baec50-58c3-43ad-bb1d-6d45f1cba9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (482b9197-3bfd-4b63-989d-97bac148b432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-26ea1cba-ad06-4923-96bd-038e7fab7b55 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (8fbddc2b-f572-4c12-9ba3-582f4586707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d597ee-9811-4d5b-83a7-03df6186f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d597ee-9811-4d5b-83a7-03df6186f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790920679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:46Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c502a7b-767e-4cf6-ac5a-db35b9656a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c502a7b-767e-4cf6-ac5a-db35b9656a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8622291c-10d5-4c59-8e8d-4580aefeb06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8622291c-10d5-4c59-8e8d-4580aefeb06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792', 'volume_name': 'volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a938f784-ee04-4512-8ad8-14e5a089fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a938f784-ee04-4512-8ad8-14e5a089fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1679ed-1047-49f0-a9b1-9c0f245e0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792', 'volume_size': 1} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:34:46 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (ce3fe336-a5a5-4d51-b1f6-34276c4b9586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2370cee1-aa59-474b-a23f-88fb360a8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff 1073741824" returned: 0 in 0.564s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2370cee1-aa59-474b-a23f-88fb360a8480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358820689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d50579-a63e-448c-828d-24b877add9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:46Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbdd694-a4a4-434f-aeb5-32b1f0b27b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbdd694-a4a4-434f-aeb5-32b1f0b27b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503fbb31-4607-48b9-b609-a84c064cf687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503fbb31-4607-48b9-b609-a84c064cf687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d50579-a63e-448c-828d-24b877add9c4', 'volume_name': 'volume-a5d50579-a63e-448c-828d-24b877add9c4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b83f1f-3cc7-4e41-b44a-fbfd2fbebb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b83f1f-3cc7-4e41-b44a-fbfd2fbebb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60441471-3d44-4ac1-a115-e6662c844396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume a5d50579-a63e-448c-828d-24b877add9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d50579-a63e-448c-828d-24b877add9c4', 'volume_size': 1} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:46 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff Aug 28 16:34:46 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:46 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281589836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d524ed63-d42d-4a0d-afcb-c57139f7ac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:45Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume d524ed63-d42d-4a0d-afcb-c57139f7ac41 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:46 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:46 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 1073741824 Aug 28 16:34:46 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f8b5c-826a-45a3-9aaf-2a3ca998af88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b12a751-8c9c-4822-ada0-1736024b9dff', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be36baed-d597-44dd-8a02-c18e3a2c84fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-3b12a751-8c9c-4822-ada0-1736024b9dff (3b12a751-8c9c-4822-ada0-1736024b9dff): created successfully Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be36baed-d597-44dd-8a02-c18e3a2c84fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (37c342f1-4b14-4186-ac04-496eaa3011ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-35340690-3e08-45b7-8adf-2abcfe78553a tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:47 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 1073741824" returned: 0 in 0.407s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:47 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 Aug 28 16:34:47 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:47 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41" returned: 0 in 0.251s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790920679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:46Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:47 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:47 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 1073741824 Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1182d085-9b38-4e8a-bb66-58fce06477c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:47 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f422fb28-a44d-4ff7-92d4-77ed78ec6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:47 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 (d524ed63-d42d-4a0d-afcb-c57139f7ac41): created successfully Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f422fb28-a44d-4ff7-92d4-77ed78ec6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (1671b48b-625c-458d-a6e6-0decfab8c05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-645a2c2c-e58c-4c12-bf88-a533cb2a3ef1 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:47 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 1073741824" returned: 0 in 0.415s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:47 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 Aug 28 16:34:47 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:48 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358820689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d50579-a63e-448c-828d-24b877add9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366004e7e76047dd9b044bbbe296223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:34:46Z,use_quota=True,user_id='4619d24f999947f4bcfe57e82a85acd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Creating volume a5d50579-a63e-448c-828d-24b877add9c4 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:34:48 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1679ed-1047-49f0-a9b1-9c0f245e0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:48 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 1073741824 Aug 28 16:34:48 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42c9af3-5cfc-4a1c-a493-15396d855d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 (f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792): created successfully Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42c9af3-5cfc-4a1c-a493-15396d855d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (8fbddc2b-f572-4c12-9ba3-582f4586707f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7ab2cf8e-f147-4bcf-bcd9-6d4de3ba76ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:48 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 1073741824" returned: 0 in 0.458s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:48 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 Aug 28 16:34:48 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:48 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60441471-3d44-4ac1-a115-e6662c844396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d50579-a63e-448c-828d-24b877add9c4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f480c85-19c6-4fe3-b5ca-ffa8320a2b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:34:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Volume volume-a5d50579-a63e-448c-828d-24b877add9c4 (a5d50579-a63e-448c-828d-24b877add9c4): created successfully Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f480c85-19c6-4fe3-b5ca-ffa8320a2b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:34:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Flow 'volume_create_manager' (ce3fe336-a5a5-4d51-b1f6-34276c4b9586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:34:48 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-86b00e97-5534-4587-9747-46c1a8f66da5 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created volume successfully. Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-a5d50579-a63e-448c-828d-24b877add9c4-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-a5d50579-a63e-448c-828d-24b877add9c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-a5d50579-a63e-448c-828d-24b877add9c4" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-a5d50579-a63e-448c-828d-24b877add9c4" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[833de644-c21a-4b50-9881-795dfce116b9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:49 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 Aug 28 16:34:49 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:50 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4" returned: 0 in 0.370s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:50 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4 Aug 28 16:34:50 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:50 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a5d50579-a63e-448c-828d-24b877add9c4" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-a5d50579-a63e-448c-828d-24b877add9c4" released by "delete_volume" :: held 0.654s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['c4271ac5-f45b-4f7d-a0fc-1a7d9151fa40', 'caf67ce1-a957-43b5-bbeb-9e9bbf529f52', '9915fc15-1666-4caf-8bdc-e62e3e6d2b83', 'c699d254-45ea-4576-8eca-4d00a11ed8a8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:50 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:50 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:50 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.265s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-04aee67b-3ee6-4223-a7ca-27540d40f9ff tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-a5d50579-a63e-448c-828d-24b877add9c4-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12fd0f4-86b1-4080-aef6-8f24d7ce4135]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:51 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 Aug 28 16:34:51 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:51 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" returned: 0 in 0.380s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:51 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792 Aug 28 16:34:51 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:51 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792" released by "delete_volume" :: held 0.704s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['216ffe11-1994-4262-98ee-3a91c2591669', '53a73f2d-170f-4d15-91b8-5bf75cc40be6', 'f6a90668-b28f-4464-a63f-36a5691b8aa6', '7aed39c9-60b3-4531-9162-aafb4bf0cc92'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:51 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:51 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-d524ed63-d42d-4a0d-afcb-c57139f7ac41-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-d524ed63-d42d-4a0d-afcb-c57139f7ac41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-d524ed63-d42d-4a0d-afcb-c57139f7ac41" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:52 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-d524ed63-d42d-4a0d-afcb-c57139f7ac41" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6766748-9b56-4fc2-92ef-01e274cbf7a2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f5c21a1-e19c-49c8-b409-611299c6da88 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-f8d6c7d8-ebc2-4ecf-a750-5e6eef57d792-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:52 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 Aug 28 16:34:52 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:52 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41" returned: 0 in 0.385s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:52 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41 Aug 28 16:34:52 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:52 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d524ed63-d42d-4a0d-afcb-c57139f7ac41" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-d524ed63-d42d-4a0d-afcb-c57139f7ac41" released by "delete_volume" :: held 0.674s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['343b2b62-d8d0-451b-b8dd-f941f52caa16', '791791b1-42b1-4851-9f17-a8c6e60a903c', 'a5930bb4-da1a-414d-9f4f-db70924a655a', '76238425-2b89-4e4f-826d-4703f9b1c3a6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:52 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:52 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:53 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.278s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-3b12a751-8c9c-4822-ada0-1736024b9dff-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bb1cced9-9cc2-4ae2-a373-9a271e641181 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-d524ed63-d42d-4a0d-afcb-c57139f7ac41-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-3b12a751-8c9c-4822-ada0-1736024b9dff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-3b12a751-8c9c-4822-ada0-1736024b9dff" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-3b12a751-8c9c-4822-ada0-1736024b9dff" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[242084e2-3a18-47a5-852a-3e4e13bb8e0d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:53 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff Aug 28 16:34:53 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:53 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff" returned: 0 in 0.368s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:53 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff Aug 28 16:34:53 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:53 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b12a751-8c9c-4822-ada0-1736024b9dff" returned: 0 in 0.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-3b12a751-8c9c-4822-ada0-1736024b9dff" released by "delete_volume" :: held 0.670s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['8c107fa6-7487-4ee2-839c-cb141ce9fbda', '5d863f1f-862f-4d0c-a00e-cfa9d752a6b2', '30174b1b-74aa-4b20-a773-754221d2befa', '29deec96-bc90-4293-a9c5-6528a8bdc2d9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:54 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:54 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:54 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-74d67f28-fc3c-4fee-928a-5706613fec85 tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-3b12a751-8c9c-4822-ada0-1736024b9dff-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-fb83af74-35ff-4daf-9c49-1cb538576c5d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-fb83af74-35ff-4daf-9c49-1cb538576c5d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-fb83af74-35ff-4daf-9c49-1cb538576c5d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-fb83af74-35ff-4daf-9c49-1cb538576c5d" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb7628f-ad21-44d1-adf1-2455da6d60ca]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:54 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d Aug 28 16:34:54 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:54 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d" returned: 0 in 0.371s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:54 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d Aug 28 16:34:54 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:55 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fb83af74-35ff-4daf-9c49-1cb538576c5d" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-fb83af74-35ff-4daf-9c49-1cb538576c5d" released by "delete_volume" :: held 0.665s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['dea6eeef-f43c-415b-9cca-fd4e18c1d08a', 'faf2a9a4-a70b-4399-9860-6d12ceb9e0a3', '04224350-7b7a-4a21-bee7-e29b220bb562', 'cee4c0d7-5c5d-4345-9961-ce53aa91d23f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:55 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:55 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:55 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.263s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d5dc6f18-1757-499e-ba86-00c125dac8ed tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-fb83af74-35ff-4daf-9c49-1cb538576c5d-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-64433dce-cfc7-474e-98a5-893ed07ea5be-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-64433dce-cfc7-474e-98a5-893ed07ea5be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-64433dce-cfc7-474e-98a5-893ed07ea5be" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-64433dce-cfc7-474e-98a5-893ed07ea5be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleting offline snapshot 64433dce-cfc7-474e-98a5-893ed07ea5be of volume bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] snapshot_file for this snap is: volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcccd01e-6753-4d92-9cc2-5b14df069b3d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:55 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be Aug 28 16:34:55 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:56 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf9603f8-6076-4054-995b-0fe04ab5ab55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c192e03c-970d-4019-91ce-9e254a666a9f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:56 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 Aug 28 16:34:56 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:56 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55" returned: 0 in 0.388s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:56 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be Aug 28 16:34:56 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:56 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:56 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be Aug 28 16:34:56 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:57 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55.64433dce-cfc7-474e-98a5-893ed07ea5be" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-64433dce-cfc7-474e-98a5-893ed07ea5be" released by "_delete_snapshot" :: held 1.472s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" released by "delete_snapshot" :: held 1.495s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['bd52c857-2174-41e1-9c09-38ea0dfcbed8', '73e63dd4-470c-424f-8fd8-4d2290eb138c', 'ace21d99-ef67-49b0-ab48-e70d29b7fa92', 'c8d5953e-f622-42e6-a89d-45beea00c739'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Delete snapshot completed successfully. Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-711ba3bd-8644-484b-b72a-b54d2f339b5a tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-64433dce-cfc7-474e-98a5-893ed07ea5be-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-bf9603f8-6076-4054-995b-0fe04ab5ab55-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-bf9603f8-6076-4054-995b-0fe04ab5ab55-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[852e0445-5d6d-4876-8eee-28ec43f285a1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:34:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:57 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 Aug 28 16:34:57 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:58 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55" returned: 0 in 0.381s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:58 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55 Aug 28 16:34:58 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:58 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bf9603f8-6076-4054-995b-0fe04ab5ab55" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-quobyte-bf9603f8-6076-4054-995b-0fe04ab5ab55" released by "delete_volume" :: held 0.701s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Created reservations ['fb48b5cf-e0f5-4756-bcec-234a69d6d676', 'f5e7d643-272d-4a85-953d-82d3142ad8fd', '12b41c67-4ec1-4edb-a816-9d48f8e2d4d1', '815c8463-915a-41e6-b2cd-82ad5cab804a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:34:58 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:34:58 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:34:58 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.269s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:34:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Deleted volume successfully. Aug 28 16:34:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b40ed885-62cb-4eab-8f23-71b27824a67f tempest-CreateVolumesFromSnapshotTest-714616348 None] Lock "cinder-bf9603f8-6076-4054-995b-0fe04ab5ab55-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (f9d76322-ff4c-4fab-b656-5ee7f2805fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aebbbe1-b963-48ab-97f0-dde4d7f106aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aebbbe1-b963-48ab-97f0-dde4d7f106aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346118010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1658d6-d398-4031-a702-a4bbce6be209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:02Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7082a40d-a58f-4bdc-bd0f-6fb70cea60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7082a40d-a58f-4bdc-bd0f-6fb70cea60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9678d3b-a623-4073-9b15-713773d16cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9678d3b-a623-4073-9b15-713773d16cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1658d6-d398-4031-a702-a4bbce6be209', 'volume_name': 'volume-8a1658d6-d398-4031-a702-a4bbce6be209', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349e4b6c-8e3f-4876-b75b-35f604b2909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349e4b6c-8e3f-4876-b75b-35f604b2909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282d868e-e134-475d-afe6-1a1f4322b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume 8a1658d6-d398-4031-a702-a4bbce6be209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1658d6-d398-4031-a702-a4bbce6be209', 'volume_size': 1} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1346118010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1658d6-d398-4031-a702-a4bbce6be209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:02Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume 8a1658d6-d398-4031-a702-a4bbce6be209 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:01 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 1073741824 Aug 28 16:35:01 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:02 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 1073741824" returned: 0 in 0.451s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:02 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 Aug 28 16:35:02 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:02 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282d868e-e134-475d-afe6-1a1f4322b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1658d6-d398-4031-a702-a4bbce6be209', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e4b476-cb8f-4d60-870d-dd788256d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-8a1658d6-d398-4031-a702-a4bbce6be209 (8a1658d6-d398-4031-a702-a4bbce6be209): created successfully Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e4b476-cb8f-4d60-870d-dd788256d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (f9d76322-ff4c-4fab-b656-5ee7f2805fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-95393aab-67ca-4ac0-b7a4-f6f8f9db1d9f tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (b28d3f25-0d93-4c9d-8879-6e317d95d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501d4160-c4ad-47d6-90a3-1d729ee6a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501d4160-c4ad-47d6-90a3-1d729ee6a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104108359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a913a7-0dc3-4612-ae96-c34478f2396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:03Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6ac9a-8899-4a67-8110-f1f95a7805ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6ac9a-8899-4a67-8110-f1f95a7805ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b06a426-699f-4814-9b4e-82e7257ee818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b06a426-699f-4814-9b4e-82e7257ee818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a913a7-0dc3-4612-ae96-c34478f2396d', 'volume_name': 'volume-76a913a7-0dc3-4612-ae96-c34478f2396d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245409c8-ac00-44ca-acee-94e52cbb6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245409c8-ac00-44ca-acee-94e52cbb6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9908dacd-66f6-49f4-8531-fa20010fc6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume 76a913a7-0dc3-4612-ae96-c34478f2396d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a913a7-0dc3-4612-ae96-c34478f2396d', 'volume_size': 1} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104108359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a913a7-0dc3-4612-ae96-c34478f2396d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:03Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume 76a913a7-0dc3-4612-ae96-c34478f2396d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:03 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:03 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d 1073741824 Aug 28 16:35:03 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (8421193d-06ac-4065-9286-a42c2a3c8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439b2eca-7ec4-4023-acef-362b804f40d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439b2eca-7ec4-4023-acef-362b804f40d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768384618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372e3819-5b40-4fea-baeb-b0ea5d7c60d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbdad9e-10db-4c7e-9304-e79bebb18a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbdad9e-10db-4c7e-9304-e79bebb18a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df92ddb6-c18a-4421-a706-73ffae155398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df92ddb6-c18a-4421-a706-73ffae155398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372e3819-5b40-4fea-baeb-b0ea5d7c60d6', 'volume_name': 'volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6ad30b-290b-460c-be5a-100438d0e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6ad30b-290b-460c-be5a-100438d0e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d64bfba-cfeb-4c33-9b27-b8327b2cfc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume 372e3819-5b40-4fea-baeb-b0ea5d7c60d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6', 'volume_size': 1} Aug 28 16:35:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:04 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d 1073741824" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:04 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d Aug 28 16:35:04 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (293994cf-5286-4434-a73f-223d67385a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e6f23-f0b3-4e28-8f97-b0bfbba18aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45e6f23-f0b3-4e28-8f97-b0bfbba18aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509111805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc1e740-411c-4a25-b268-59f54be3371d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0fb831-fba3-460c-a212-f6322a9664f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0fb831-fba3-460c-a212-f6322a9664f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70175bf4-95a7-4da2-a2eb-f581e6e622b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70175bf4-95a7-4da2-a2eb-f581e6e622b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc1e740-411c-4a25-b268-59f54be3371d', 'volume_name': 'volume-fdc1e740-411c-4a25-b268-59f54be3371d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100807a4-2660-4cee-b823-addc50044b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100807a4-2660-4cee-b823-addc50044b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5166b8-6f23-4cb1-a97f-219bd94ba754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume fdc1e740-411c-4a25-b268-59f54be3371d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc1e740-411c-4a25-b268-59f54be3371d', 'volume_size': 1} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:04 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-768384618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372e3819-5b40-4fea-baeb-b0ea5d7c60d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume 372e3819-5b40-4fea-baeb-b0ea5d7c60d6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:04 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9908dacd-66f6-49f4-8531-fa20010fc6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a913a7-0dc3-4612-ae96-c34478f2396d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e60bfc-8649-4d9f-a859-d9ce3f6c9ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 1073741824 Aug 28 16:35:04 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-76a913a7-0dc3-4612-ae96-c34478f2396d (76a913a7-0dc3-4612-ae96-c34478f2396d): created successfully Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e60bfc-8649-4d9f-a859-d9ce3f6c9ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (b28d3f25-0d93-4c9d-8879-6e317d95d649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0ae85c8d-ca9d-48cc-8e29-94aadbc9008b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (528d7db3-b01f-4ac5-a3b8-a2fbf0155ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404528db-f923-40f3-b77b-2c9f64507a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404528db-f923-40f3-b77b-2c9f64507a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57395794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529c8f4e-ba2b-418c-b74b-4fd8a7160752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b72ad-55a9-4549-9e58-61be9cf8ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4b72ad-55a9-4549-9e58-61be9cf8ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6e0a7c-447b-49ce-9300-e1636e2fc245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6e0a7c-447b-49ce-9300-e1636e2fc245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529c8f4e-ba2b-418c-b74b-4fd8a7160752', 'volume_name': 'volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a46bb0-5615-4f80-8bdd-c3568d023b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a46bb0-5615-4f80-8bdd-c3568d023b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b47df6-f20a-4ed7-bf88-b76e265f5b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume 529c8f4e-ba2b-418c-b74b-4fd8a7160752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752', 'volume_size': 1} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:04 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 1073741824" returned: 0 in 0.499s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:04 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 Aug 28 16:35:04 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (d3265481-002d-4748-bb20-0d4b572c7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c32a118-3074-40ed-b0b2-6f0f735e4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:04 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c32a118-3074-40ed-b0b2-6f0f735e4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824072128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915dddd5-9956-4c6e-aaea-9f0bce1a6a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:05Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac76546-adce-4d7f-8342-676c60e3834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac76546-adce-4d7f-8342-676c60e3834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e692a5-48a5-4eee-a82c-4536ddf1398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e692a5-48a5-4eee-a82c-4536ddf1398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915dddd5-9956-4c6e-aaea-9f0bce1a6a01', 'volume_name': 'volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f63f41f-479f-453f-ac16-db89b0cdc7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f63f41f-479f-453f-ac16-db89b0cdc7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a60a65-113d-48ce-9913-e386d2182580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume 915dddd5-9956-4c6e-aaea-9f0bce1a6a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01', 'volume_size': 1} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:05 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" returned: 0 in 0.251s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509111805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc1e740-411c-4a25-b268-59f54be3371d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume fdc1e740-411c-4a25-b268-59f54be3371d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d64bfba-cfeb-4c33-9b27-b8327b2cfc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d 1073741824 Aug 28 16:35:05 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fd2dbe-677c-4bf6-85e4-17dd86b389a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 (372e3819-5b40-4fea-baeb-b0ea5d7c60d6): created successfully Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fd2dbe-677c-4bf6-85e4-17dd86b389a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (8421193d-06ac-4065-9286-a42c2a3c8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b0183805-c3be-460a-8de8-2fa3ba5382e8 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:05 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d 1073741824" returned: 0 in 0.438s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:05 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d Aug 28 16:35:05 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:05 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d" returned: 0 in 0.267s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-57395794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529c8f4e-ba2b-418c-b74b-4fd8a7160752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:04Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume 529c8f4e-ba2b-418c-b74b-4fd8a7160752 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5166b8-6f23-4cb1-a97f-219bd94ba754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc1e740-411c-4a25-b268-59f54be3371d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ad9e8d-c410-419b-93b4-c09fc1470c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:05 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 1073741824 Aug 28 16:35:05 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-fdc1e740-411c-4a25-b268-59f54be3371d (fdc1e740-411c-4a25-b268-59f54be3371d): created successfully Aug 28 16:35:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ad9e8d-c410-419b-93b4-c09fc1470c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (293994cf-5286-4434-a73f-223d67385a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9701f06e-7227-4241-9afa-ba1a013cb058 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:06 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 1073741824" returned: 0 in 0.416s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:06 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 Aug 28 16:35:06 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:06 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752" returned: 0 in 0.230s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824072128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915dddd5-9956-4c6e-aaea-9f0bce1a6a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2f3068ad8d34461b8bbd6763f2d9eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:05Z,use_quota=True,user_id='8fbd241950704fcfa29177ed15029df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Creating volume 915dddd5-9956-4c6e-aaea-9f0bce1a6a01 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:06 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:06 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 1073741824 Aug 28 16:35:06 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b47df6-f20a-4ed7-bf88-b76e265f5b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc2e1d6-e39b-414b-aa25-e105bb53dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 (529c8f4e-ba2b-418c-b74b-4fd8a7160752): created successfully Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc2e1d6-e39b-414b-aa25-e105bb53dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (528d7db3-b01f-4ac5-a3b8-a2fbf0155ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a321c733-afb7-4376-b0c8-5cf99c3bceec tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:07 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 1073741824" returned: 0 in 0.403s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:07 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 Aug 28 16:35:07 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:07 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a60a65-113d-48ce-9913-e386d2182580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438761ca-1df7-4592-a315-11d4cb0436b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Volume volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 (915dddd5-9956-4c6e-aaea-9f0bce1a6a01): created successfully Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438761ca-1df7-4592-a315-11d4cb0436b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Flow 'volume_create_manager' (d3265481-002d-4748-bb20-0d4b572c7798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5638ac9f-7505-4f22-9b6b-f1d5393298df tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created volume successfully. Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-915dddd5-9956-4c6e-aaea-9f0bce1a6a01-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-915dddd5-9956-4c6e-aaea-9f0bce1a6a01-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b4fb52-b8cc-478f-8e10-a43330f391a3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:08 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 Aug 28 16:35:08 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:08 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:08 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01 Aug 28 16:35:08 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:09 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-915dddd5-9956-4c6e-aaea-9f0bce1a6a01" released by "delete_volume" :: held 0.679s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['06bf6159-b717-4c11-aede-bbe1698207b3', 'c277bc5d-795b-4154-8f60-a33671497a28', '8a24e3f0-c4a3-4ee2-a6a4-4714613d739c', '9652a61c-7af6-4f93-877d-9bb867c993e8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:09 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:09 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:09 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.259s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:09 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-83df623e-53e0-4910-88b0-ea4fee507957 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-915dddd5-9956-4c6e-aaea-9f0bce1a6a01-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-529c8f4e-ba2b-418c-b74b-4fd8a7160752-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-529c8f4e-ba2b-418c-b74b-4fd8a7160752-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-529c8f4e-ba2b-418c-b74b-4fd8a7160752" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-529c8f4e-ba2b-418c-b74b-4fd8a7160752" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f290eb3-83e1-4954-80d5-490c142110ec]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:09 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 Aug 28 16:35:09 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:09 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752" returned: 0 in 0.345s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:09 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752 Aug 28 16:35:09 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:10 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-529c8f4e-ba2b-418c-b74b-4fd8a7160752" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-529c8f4e-ba2b-418c-b74b-4fd8a7160752" released by "delete_volume" :: held 0.627s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['626dc7c0-1746-4136-bc74-9e7e646ed836', '3c7ca964-48e9-4d74-8d2a-cce6cf897768', 'd818c59b-345b-4525-8d81-5f960fd10a74', 'c8ed533b-f63f-4d7e-8814-ab20a7ac2e41'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:10 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:10 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:10 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.241s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-ac48e8e8-85e6-4c98-8f6e-1ad8e09a3906 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-529c8f4e-ba2b-418c-b74b-4fd8a7160752-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-fdc1e740-411c-4a25-b268-59f54be3371d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-fdc1e740-411c-4a25-b268-59f54be3371d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-fdc1e740-411c-4a25-b268-59f54be3371d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-fdc1e740-411c-4a25-b268-59f54be3371d" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23061f-3258-49fc-8197-53c5d3238a9a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:10 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d Aug 28 16:35:10 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:11 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d" returned: 0 in 0.360s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:11 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d Aug 28 16:35:11 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:11 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fdc1e740-411c-4a25-b268-59f54be3371d" returned: 0 in 0.249s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-fdc1e740-411c-4a25-b268-59f54be3371d" released by "delete_volume" :: held 0.647s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['caf7a488-b4eb-408b-bbf2-62c4f71d4d1a', '4ca9d4af-b8e3-4ca9-91ee-b9310ad75f69', '833734e3-e034-4951-a26d-6170c8722d81', '65af2e46-41d3-4c36-b67e-62ed6d53dc9b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:11 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:11 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:11 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f30a043-04d3-4f6e-bc44-f7b610ccb892 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-fdc1e740-411c-4a25-b268-59f54be3371d-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-372e3819-5b40-4fea-baeb-b0ea5d7c60d6-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-372e3819-5b40-4fea-baeb-b0ea5d7c60d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec206d4-03b3-41ed-b9cf-fc058a508509]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:11 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 Aug 28 16:35:11 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:12 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:12 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6 Aug 28 16:35:12 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:12 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-372e3819-5b40-4fea-baeb-b0ea5d7c60d6" released by "delete_volume" :: held 0.661s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['f939b2d0-2fcb-4bc3-a17a-85f6da522fb4', '182f01c8-cb08-4f0c-b4ea-a8a8261cd274', '63967387-2142-47bb-9e06-b75f2bc2596e', '74dc64fe-6ba5-43b7-9878-32280e66f1b6'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:12 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:12 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:12 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.264s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b4abaf53-f36d-4dea-ba22-2eedb56812b4 tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-372e3819-5b40-4fea-baeb-b0ea5d7c60d6-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-76a913a7-0dc3-4612-ae96-c34478f2396d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-76a913a7-0dc3-4612-ae96-c34478f2396d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-76a913a7-0dc3-4612-ae96-c34478f2396d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-76a913a7-0dc3-4612-ae96-c34478f2396d" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[510705bd-ecf9-4b1e-ad33-4907aa96cea8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:13 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d Aug 28 16:35:13 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:13 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d" returned: 0 in 0.417s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:13 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d Aug 28 16:35:13 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:13 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-76a913a7-0dc3-4612-ae96-c34478f2396d" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-76a913a7-0dc3-4612-ae96-c34478f2396d" released by "delete_volume" :: held 0.718s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['75bd09a1-8fac-4480-9716-438833d56f67', '1721d082-3998-424b-8aed-caf40cff0cb7', '44b110ac-47aa-4ae2-b42d-4291289b644d', 'dbb23630-234a-461a-8693-928678873821'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:13 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:13 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-8a1658d6-d398-4031-a702-a4bbce6be209-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:14 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.272s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-8a1658d6-d398-4031-a702-a4bbce6be209-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dc114b36-654f-49a0-b51b-0c5053d42c0b tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-76a913a7-0dc3-4612-ae96-c34478f2396d-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "cinder-quobyte-8a1658d6-d398-4031-a702-a4bbce6be209" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-8a1658d6-d398-4031-a702-a4bbce6be209" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2788773f-e0d8-486a-9ae0-9c3f8d01189d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:14 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 Aug 28 16:35:14 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:14 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:14 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209 Aug 28 16:35:14 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:14 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8a1658d6-d398-4031-a702-a4bbce6be209" returned: 0 in 0.265s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-quobyte-8a1658d6-d398-4031-a702-a4bbce6be209" released by "delete_volume" :: held 0.692s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:14 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Created reservations ['79f195d3-1040-49d2-ae49-e400df5683c6', '69fa94c2-035d-4540-a66e-c0378fb37834', 'e6ad977a-2e36-4a9a-98cc-c679f86af127', '038cf081-9639-4ee7-b24c-813264123d2b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:15 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:15 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:15 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.273s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Deleted volume successfully. Aug 28 16:35:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0bf9c3ae-d606-45b3-8c2f-d3c87c912abd tempest-CreateVolumesFromSourceVolumeTest-91579902 None] Lock "cinder-8a1658d6-d398-4031-a702-a4bbce6be209-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Flow 'volume_create_manager' (a872467f-80c2-4486-b4ce-5221d7cc9864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848df528-4f1a-4fbd-8ed6-2b1896cdc4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848df528-4f1a-4fbd-8ed6-2b1896cdc4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133839403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce30886-73f0-45ba-b872-44c5ceeaa7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2c25e7b60f44da9b7c0f37c26771a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:18Z,use_quota=True,user_id='cd0df4c3de7945329c6e66ebb8c6707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6dabd0-b966-4700-9939-cc83a5c5cc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6dabd0-b966-4700-9939-cc83a5c5cc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9ca568-2ea8-4402-a53a-d5aa096f7212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9ca568-2ea8-4402-a53a-d5aa096f7212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce30886-73f0-45ba-b872-44c5ceeaa7cd', 'volume_name': 'volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb76927a-d5f5-43df-9059-9ebaf1550b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb76927a-d5f5-43df-9059-9ebaf1550b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96dd290-6960-47d8-b015-833e064e72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:18 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Volume cce30886-73f0-45ba-b872-44c5ceeaa7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd', 'volume_size': 1} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133839403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce30886-73f0-45ba-b872-44c5ceeaa7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2c25e7b60f44da9b7c0f37c26771a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:18Z,use_quota=True,user_id='cd0df4c3de7945329c6e66ebb8c6707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Creating volume cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:18 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:18 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd 1073741824 Aug 28 16:35:18 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:18 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd 1073741824" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:18 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:18 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:19 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.272s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96dd290-6960-47d8-b015-833e064e72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4d597c-7217-4730-9d90-b8ce73c15ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:19 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Volume volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd (cce30886-73f0-45ba-b872-44c5ceeaa7cd): created successfully Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4d597c-7217-4730-9d90-b8ce73c15ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Flow 'volume_create_manager' (a872467f-80c2-4486-b4ce-5221d7cc9864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-53dc9c7a-ca52-4ab5-8506-f315ced6e2eb tempest-VolumeDependencyTests-1531744978 None] Created volume successfully. Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Creating offline snapshot 43a23684-7f3c-4938-be2e-b3193e1976ba of volume cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[80734741-ee34-41b2-92d5-c6363a5c2c26]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:19 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:19 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:19 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.374s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:19 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba 1G Aug 28 16:35:19 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:20 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba 1G" returned: 0 in 0.403s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:20 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:20 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:20 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:20 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba is being set with open permissions: ugo+rw Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:20 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:20 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:20 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:20 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info Aug 28 16:35:20 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:21 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:21 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info is being set with open permissions: ugo+rw Aug 28 16:35:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:21 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info Aug 28 16:35:21 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:21 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.info" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7cf7f1c8-1c8a-4cda-9eee-32392db5c78a tempest-VolumeDependencyTests-1531744978 None] Create snapshot completed successfully Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Flow 'volume_create_manager' (a07e2ac7-ff80-4d2c-a591-231fc110f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f420e28c-d14e-40ed-b16d-013f2e6619ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f420e28c-d14e-40ed-b16d-013f2e6619ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-953331650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84f43e5-6873-4ed2-91ef-fbfb73ecba73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2c25e7b60f44da9b7c0f37c26771a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43a23684-7f3c-4938-be2e-b3193e1976ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:22Z,use_quota=True,user_id='cd0df4c3de7945329c6e66ebb8c6707a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb6f4da-9ca1-4d46-9da4-0760dc6c8a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb6f4da-9ca1-4d46-9da4-0760dc6c8a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badeb6f5-ee01-40c9-9502-29c8c5b00b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badeb6f5-ee01-40c9-9502-29c8c5b00b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b84f43e5-6873-4ed2-91ef-fbfb73ecba73', 'volume_name': 'volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73', 'volume_size': 1, 'snapshot_id': '43a23684-7f3c-4938-be2e-b3193e1976ba'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad329aef-5730-4537-92fd-509301a010b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad329aef-5730-4537-92fd-509301a010b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4811c98a-fe12-4bd8-8302-7d2052cf69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:22 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Volume b84f43e5-6873-4ed2-91ef-fbfb73ecba73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73', 'volume_size': 1, 'snapshot_id': '43a23684-7f3c-4938-be2e-b3193e1976ba'} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Creating volume b84f43e5-6873-4ed2-91ef-fbfb73ecba73 from snapshot 43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] snapshot: 43a23684-7f3c-4938-be2e-b3193e1976ba, volume: b84f43e5-6873-4ed2-91ef-fbfb73ecba73, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a8a7a6-9d22-43e7-ba5c-3983b8c662a7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:22 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:22 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:22 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2796ef7-2d92-459b-9795-0677b6ff85ee]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:22 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:22 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:23 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.374s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:35:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:35:23 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:35:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:23 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 Aug 28 16:35:23 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:27 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" returned: 0 in 4.079s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:35:27 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Converted 1024.00 MB image at 250.94 MB/s Aug 28 16:35:27 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 is being set with open permissions: ugo+rw Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:27 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 Aug 28 16:35:27 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:27 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" released by "_copy_volume_from_snapshot" :: held 5.162s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" released by "_create_volume_from_snapshot" :: held 5.225s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.241s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4811c98a-fe12-4bd8-8302-7d2052cf69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73', 'volume_size': 1, 'snapshot_id': '43a23684-7f3c-4938-be2e-b3193e1976ba'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113397ac-d4f9-457a-98c3-34579b531031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Volume volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 (b84f43e5-6873-4ed2-91ef-fbfb73ecba73): created successfully Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113397ac-d4f9-457a-98c3-34579b531031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Flow 'volume_create_manager' (a07e2ac7-ff80-4d2c-a591-231fc110f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9256ae75-031c-4cdc-846a-33bbeaced648 tempest-VolumeDependencyTests-1531744978 None] Created volume successfully. Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-43a23684-7f3c-4938-be2e-b3193e1976ba-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-43a23684-7f3c-4938-be2e-b3193e1976ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Deleting offline snapshot 43a23684-7f3c-4938-be2e-b3193e1976ba of volume cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] snapshot_file for this snap is: volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27991be-1c0f-4170-aee7-25d4d95f6b05]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:27 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:27 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:28 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1513e-7b49-4421-a7b5-ec1ba7f53bce]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:28 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:28 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:28 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.513s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:28 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:28 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:28 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.327s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:28 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba Aug 28 16:35:28 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:29 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd.43a23684-7f3c-4938-be2e-b3193e1976ba" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-43a23684-7f3c-4938-be2e-b3193e1976ba" released by "_delete_snapshot" :: held 1.521s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" released by "delete_snapshot" :: held 1.545s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Created reservations ['615b73dd-8fb5-47f4-a19b-350146f135f2', '5ddf4ee7-0fdb-4c20-834a-6e101414cd97', 'aa10a919-40bc-4808-bbad-03acf66d54ea', '96bb6458-b0c5-4ad4-8f70-4ec53ba76bee'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Delete snapshot completed successfully. Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-89817e62-4468-4544-ac95-37b89d9e8d31 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-43a23684-7f3c-4938-be2e-b3193e1976ba-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-cce30886-73f0-45ba-b872-44c5ceeaa7cd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-cce30886-73f0-45ba-b872-44c5ceeaa7cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b46130-98ca-4122-8939-e345c0dc702a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:30 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:30 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:30 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:30 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd Aug 28 16:35:30 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:30 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-cce30886-73f0-45ba-b872-44c5ceeaa7cd" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-cce30886-73f0-45ba-b872-44c5ceeaa7cd" released by "delete_volume" :: held 0.680s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Created reservations ['17ea0ebd-ad68-480b-af9a-7eee26fd3e35', 'de4340ae-36b9-4d13-bde8-5afa0aff9350', '32edf72c-60f7-4d7a-82c8-f75d7deb5376', '61cad33c-8420-4e75-b505-f730837a852a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:30 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:30 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:30 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Deleted volume successfully. Aug 28 16:35:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2b7d9d2b-08a8-4660-9a5d-dac319d696f7 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-cce30886-73f0-45ba-b872-44c5ceeaa7cd-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-b84f43e5-6873-4ed2-91ef-fbfb73ecba73-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-b84f43e5-6873-4ed2-91ef-fbfb73ecba73-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c2c06-6afd-455c-ba23-c6441fe2eebf]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:31 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 Aug 28 16:35:31 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:31 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:31 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:31 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" returned: 0 in 0.371s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:31 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73 Aug 28 16:35:31 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:31 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.278s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:35:31 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-quobyte-b84f43e5-6873-4ed2-91ef-fbfb73ecba73" released by "delete_volume" :: held 0.671s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Created reservations ['5b759273-3aed-4dad-8091-9e3a5b69337d', '9ad71ce7-0bd9-458d-8482-d6fe68436579', '415b5062-2537-419c-a644-45a88b49816e', '1b053572-d452-4b94-84e8-1839cf957469'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:31 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:31 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:32 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.272s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Deleted volume successfully. Aug 28 16:35:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4144587a-cc13-4f8c-bb76-af4169318d65 tempest-VolumeDependencyTests-1531744978 None] Lock "cinder-b84f43e5-6873-4ed2-91ef-fbfb73ecba73-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Flow 'volume_create_manager' (8ac0ca99-b431-4676-a0dd-10053d98158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d64592-f4ad-4af5-b028-24e5b3775710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d64592-f4ad-4af5-b028-24e5b3775710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcae56c8-938f-4b40-addd-b93918b33906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092f6e85c754593b6cfd8f5439ff859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:35Z,use_quota=True,user_id='d1a3366b72704492a4f6ecf1f4cd0419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c00b31-cb21-4690-a209-04d6e8b3961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c00b31-cb21-4690-a209-04d6e8b3961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf18a54-c085-4dea-aa38-f501c1f34706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf18a54-c085-4dea-aa38-f501c1f34706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcae56c8-938f-4b40-addd-b93918b33906', 'volume_name': 'volume-bcae56c8-938f-4b40-addd-b93918b33906', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f9261-3875-4b32-9e05-c711f34a1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155f9261-3875-4b32-9e05-c711f34a1749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3366b455-8f6e-4666-aa64-26e7d7ab1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:35 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Volume bcae56c8-938f-4b40-addd-b93918b33906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcae56c8-938f-4b40-addd-b93918b33906', 'volume_size': 1} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcae56c8-938f-4b40-addd-b93918b33906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092f6e85c754593b6cfd8f5439ff859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:35Z,use_quota=True,user_id='d1a3366b72704492a4f6ecf1f4cd0419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Creating volume bcae56c8-938f-4b40-addd-b93918b33906 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:35 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:35 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 1073741824 Aug 28 16:35:35 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:35 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 1073741824" returned: 0 in 0.437s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:35 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 Aug 28 16:35:35 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:36 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906" returned: 0 in 0.252s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3366b455-8f6e-4666-aa64-26e7d7ab1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcae56c8-938f-4b40-addd-b93918b33906', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9289a1e1-da8d-4232-8c5a-4b466550fb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Volume volume-bcae56c8-938f-4b40-addd-b93918b33906 (bcae56c8-938f-4b40-addd-b93918b33906): created successfully Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9289a1e1-da8d-4232-8c5a-4b466550fb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Flow 'volume_create_manager' (8ac0ca99-b431-4676-a0dd-10053d98158d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-de29c7d2-cf34-42a5-b7ed-ac08174d79fd tempest-CinderUnicodeTest-26087038 None] Created volume successfully. Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Flow 'volume_create_manager' (1bcc2a50-39ad-48ab-b417-cbd34ccbe9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af0981-5c48-4216-aa16-f26d696b94c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af0981-5c48-4216-aa16-f26d696b94c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1710549794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a9c9c7-29eb-4a83-a370-f8094595a721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092f6e85c754593b6cfd8f5439ff859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:37Z,use_quota=True,user_id='d1a3366b72704492a4f6ecf1f4cd0419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf458d65-5edc-4ede-9ec2-19324480d508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf458d65-5edc-4ede-9ec2-19324480d508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215cf9dd-99d0-4e51-9888-55d16eaf621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215cf9dd-99d0-4e51-9888-55d16eaf621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a9c9c7-29eb-4a83-a370-f8094595a721', 'volume_name': 'volume-f2a9c9c7-29eb-4a83-a370-f8094595a721', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4834fb-abdf-4290-9147-5a852b277061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4834fb-abdf-4290-9147-5a852b277061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c6679-12e9-498a-8c16-72fdc32cff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Volume f2a9c9c7-29eb-4a83-a370-f8094595a721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a9c9c7-29eb-4a83-a370-f8094595a721', 'volume_size': 1} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1710549794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a9c9c7-29eb-4a83-a370-f8094595a721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0092f6e85c754593b6cfd8f5439ff859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:37Z,use_quota=True,user_id='d1a3366b72704492a4f6ecf1f4cd0419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Creating volume f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:36 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:36 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 1073741824 Aug 28 16:35:36 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:37 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 1073741824" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:37 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 Aug 28 16:35:37 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:37 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721" returned: 0 in 0.250s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48c6679-12e9-498a-8c16-72fdc32cff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a9c9c7-29eb-4a83-a370-f8094595a721', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ea8457-f390-4d6c-b817-eda42905813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:37 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Volume volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 (f2a9c9c7-29eb-4a83-a370-f8094595a721): created successfully Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ea8457-f390-4d6c-b817-eda42905813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Flow 'volume_create_manager' (1bcc2a50-39ad-48ab-b417-cbd34ccbe9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e56c8b05-c61b-41b6-841d-ad26d42d3ade tempest-CinderUnicodeTest-26087038 None] Created volume successfully. Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Creating offline snapshot d33b916e-4c55-406f-8b26-efbaf4c933bf of volume f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f0402-7af1-4251-88e0-f33170679d1d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:38 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 Aug 28 16:35:38 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:38 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721" returned: 0 in 0.379s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:38 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf 1G Aug 28 16:35:38 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:38 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf 1G" returned: 0 in 0.388s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:38 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf Aug 28 16:35:38 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:39 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf" returned: 0 in 0.286s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:39 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf is being set with open permissions: ugo+rw Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:39 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf Aug 28 16:35:39 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:39 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:39 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info Aug 28 16:35:39 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:39 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info" returned: 0 in 0.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:39 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info is being set with open permissions: ugo+rw Aug 28 16:35:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:39 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info Aug 28 16:35:39 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:40 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.info" returned: 0 in 0.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-adab7fa1-3689-45ff-8037-2c402613a443 tempest-CinderUnicodeTest-26087038 None] Create snapshot completed successfully Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-d33b916e-4c55-406f-8b26-efbaf4c933bf-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-d33b916e-4c55-406f-8b26-efbaf4c933bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-quobyte-d33b916e-4c55-406f-8b26-efbaf4c933bf" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-d33b916e-4c55-406f-8b26-efbaf4c933bf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Deleting offline snapshot d33b916e-4c55-406f-8b26-efbaf4c933bf of volume f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] snapshot_file for this snap is: volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d972f-f0c0-4b1f-87aa-c98b6c7d3f8e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:41 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf Aug 28 16:35:41 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:41 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a9c9c7-29eb-4a83-a370-f8094595a721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b3b7c3-a7b0-44c7-a436-eb3bde7d246f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:41 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 Aug 28 16:35:41 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:42 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:42 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf Aug 28 16:35:42 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:42 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf" returned: 0 in 0.337s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:42 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf Aug 28 16:35:42 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:42 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721.d33b916e-4c55-406f-8b26-efbaf4c933bf" returned: 0 in 0.250s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=119,cinder:INSERT=47,cinder:UPDATE=169,cinder:DELETE=14 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=181,cinder:DELETE=19,cinder:SELECT=131,cinder:INSERT=36 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-d33b916e-4c55-406f-8b26-efbaf4c933bf" released by "_delete_snapshot" :: held 1.415s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" released by "delete_snapshot" :: held 1.437s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Created reservations ['4f42d10d-9323-4f51-b068-b7fdebb971c2', '61c4bac4-1415-4625-b950-375796168bfe', '0bf0ac63-49d6-4713-9956-c5d998357986', '424a32b5-8f5c-4ae7-8152-a76b4cec6378'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Delete snapshot completed successfully. Aug 28 16:35:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e94b7411-72b6-4913-beca-57840b39d6e0 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-d33b916e-4c55-406f-8b26-efbaf4c933bf-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-f2a9c9c7-29eb-4a83-a370-f8094595a721-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-f2a9c9c7-29eb-4a83-a370-f8094595a721-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a2ac9-d128-4cf9-9129-def8086af947]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:43 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 Aug 28 16:35:43 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:43 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:43 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721 Aug 28 16:35:43 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:44 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f2a9c9c7-29eb-4a83-a370-f8094595a721" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-f2a9c9c7-29eb-4a83-a370-f8094595a721" released by "delete_volume" :: held 0.681s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Created reservations ['1d933880-1aca-4a81-978f-b38a8000f44c', '86a5e651-ba5a-4f3c-9a8d-9561242f75a9', '296944b1-8ae6-4c38-9dd5-eb6f0cafa0ed', 'fee72f56-7e9c-4bba-82a8-c94f385b2487'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:44 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:44 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:44 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.262s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Deleted volume successfully. Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-bcae56c8-938f-4b40-addd-b93918b33906-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-90027e71-1106-463b-b9be-c14fe69f30e9 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-f2a9c9c7-29eb-4a83-a370-f8094595a721-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-bcae56c8-938f-4b40-addd-b93918b33906-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "cinder-quobyte-bcae56c8-938f-4b40-addd-b93918b33906" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-bcae56c8-938f-4b40-addd-b93918b33906" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe225b6-1832-445e-bc07-11f50d1b3995]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:35:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:44 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 Aug 28 16:35:44 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:45 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906" returned: 0 in 0.372s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:45 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906 Aug 28 16:35:45 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:45 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-bcae56c8-938f-4b40-addd-b93918b33906" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-quobyte-bcae56c8-938f-4b40-addd-b93918b33906" released by "delete_volume" :: held 0.672s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Created reservations ['3ed16973-13dd-4442-9e00-c36996979a6f', '6e547ccd-3fc7-46f1-be6b-93ed40fca849', '07daaa61-2d98-41fc-bbec-d14d6c55220c', '04a5cf05-9168-44a2-991f-66fdff5dda32'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:45 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:35:45 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:45 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:35:45 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Deleted volume successfully. Aug 28 16:35:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-07a54327-78f7-4fc4-b017-3bf353f91408 tempest-CinderUnicodeTest-26087038 None] Lock "cinder-bcae56c8-938f-4b40-addd-b93918b33906-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:35:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:35:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (237b5317-a3fe-454a-82a2-35ebb7824994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ba4952-bc42-449b-b1ef-7415547a2c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ba4952-bc42-449b-b1ef-7415547a2c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844563539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c3fc35-05d3-46be-bdb2-ced5f3e19432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:58Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ec7c01-5c32-4926-b9e6-f7965d66ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ec7c01-5c32-4926-b9e6-f7965d66ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f2ab93-6c3c-4053-9822-212f5cbe6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f2ab93-6c3c-4053-9822-212f5cbe6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c3fc35-05d3-46be-bdb2-ced5f3e19432', 'volume_name': 'volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9b8fdc-33bc-433e-9e38-f06de4ce874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9b8fdc-33bc-433e-9e38-f06de4ce874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600141d2-6989-4b0f-a967-a413d43ed50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:57 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume a8c3fc35-05d3-46be-bdb2-ced5f3e19432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432', 'volume_size': 1} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844563539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c3fc35-05d3-46be-bdb2-ced5f3e19432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:58Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume a8c3fc35-05d3-46be-bdb2-ced5f3e19432 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:57 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:35:58 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 1073741824 Aug 28 16:35:58 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (957b03e9-74d3-4928-bd3d-fac998a3f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c1cee7-c379-47ff-abad-db8c3addb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c1cee7-c379-47ff-abad-db8c3addb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899552796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:58Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1354b14d-9b7d-4e62-96fd-5eebe1a1b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1354b14d-9b7d-4e62-96fd-5eebe1a1b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeac61c-35ad-44f2-a3af-72d527bb0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaeac61c-35ad-44f2-a3af-72d527bb0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c', 'volume_name': 'volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f1865d-e414-443e-94d8-2d3db53927ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f1865d-e414-443e-94d8-2d3db53927ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2fd52-51cd-4b76-a7d1-624c2c6476a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume 3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c', 'volume_size': 1} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:58 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 1073741824" returned: 0 in 0.557s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:58 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 Aug 28 16:35:58 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:58 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" returned: 0 in 0.333s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899552796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:35:58Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume 3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:35:58 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600141d2-6989-4b0f-a967-a413d43ed50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3fcdac-7d65-4c76-9f1d-2e2e95d5d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:58 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c 1073741824 Aug 28 16:35:58 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 (a8c3fc35-05d3-46be-bdb2-ced5f3e19432): created successfully Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3fcdac-7d65-4c76-9f1d-2e2e95d5d12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (237b5317-a3fe-454a-82a2-35ebb7824994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-63abfcf4-c195-42eb-9aec-7d1a7a8d33ff tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:35:59 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c 1073741824" returned: 0 in 0.485s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:35:59 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c Aug 28 16:35:59 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:35:59 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2fd52-51cd-4b76-a7d1-624c2c6476a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0034ae4e-b811-43cd-b089-aeee6e4ee2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:35:59 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c (3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c): created successfully Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0034ae4e-b811-43cd-b089-aeee6e4ee2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:35:59 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (957b03e9-74d3-4928-bd3d-fac998a3f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:35:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ac90d878-1826-45ed-9495-5186fc5d97a0 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (e0882b80-47dd-4ca3-b0c0-8a9a45698a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783389fb-d7b9-462b-8911-7f31e91f36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783389fb-d7b9-462b-8911-7f31e91f36c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687754424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bfbabd-38a2-4d2b-8ded-8409747d4337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:00Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26970322-7e29-4ec7-8b43-867c50ffec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26970322-7e29-4ec7-8b43-867c50ffec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab2370-4296-40f9-a76e-51e1138a4c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab2370-4296-40f9-a76e-51e1138a4c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7bfbabd-38a2-4d2b-8ded-8409747d4337', 'volume_name': 'volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5713762-5b8d-4720-8ac1-8118ea193a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5713762-5b8d-4720-8ac1-8118ea193a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57dd78c-1174-4863-b167-ce34069f0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume f7bfbabd-38a2-4d2b-8ded-8409747d4337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337', 'volume_size': 1} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687754424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bfbabd-38a2-4d2b-8ded-8409747d4337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:00Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume f7bfbabd-38a2-4d2b-8ded-8409747d4337 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:00 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:00 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 1073741824 Aug 28 16:36:00 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (2b66da54-9f91-4244-bb13-35e34cd9603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb621a1-0046-466f-b738-350b880c17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb621a1-0046-466f-b738-350b880c17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1270215150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e99f27-3394-497f-a73b-9d1c7652bccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:01Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db44618-0c91-414d-bd42-2e4e692fc3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db44618-0c91-414d-bd42-2e4e692fc3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb07acf9-a17f-4534-a53e-31c73acae865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb07acf9-a17f-4534-a53e-31c73acae865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e99f27-3394-497f-a73b-9d1c7652bccd', 'volume_name': 'volume-a2e99f27-3394-497f-a73b-9d1c7652bccd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f094d-56fe-49d4-8fbd-619ce9400ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083f094d-56fe-49d4-8fbd-619ce9400ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4b7ed8-0fbd-4d05-9df3-7abda408d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume a2e99f27-3394-497f-a73b-9d1c7652bccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e99f27-3394-497f-a73b-9d1c7652bccd', 'volume_size': 1} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:01 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 1073741824" returned: 0 in 0.669s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:01 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 Aug 28 16:36:01 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (4e253fd1-0fcc-4faa-a145-4a2bcca98b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08862b7-ac1e-4997-9161-06d3e1d917d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08862b7-ac1e-4997-9161-06d3e1d917d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472533161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84f995d-5952-4ef0-a222-5123b26b1185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:01Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d53008-f661-4459-980e-68f76da870f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d53008-f661-4459-980e-68f76da870f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb6e4de-379b-458e-880c-7fb515cca2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bb6e4de-379b-458e-880c-7fb515cca2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84f995d-5952-4ef0-a222-5123b26b1185', 'volume_name': 'volume-b84f995d-5952-4ef0-a222-5123b26b1185', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68eb1650-f953-4232-b8f6-1fd1e55cd371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68eb1650-f953-4232-b8f6-1fd1e55cd371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176dc8db-4698-4247-9af3-26871bcce110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume b84f995d-5952-4ef0-a222-5123b26b1185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84f995d-5952-4ef0-a222-5123b26b1185', 'volume_size': 1} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337" returned: 0 in 0.509s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1270215150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e99f27-3394-497f-a73b-9d1c7652bccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:01Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume a2e99f27-3394-497f-a73b-9d1c7652bccd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57dd78c-1174-4863-b167-ce34069f0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca3ba32-2da0-4900-9cc1-09b8a9a4618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:01 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd 1073741824 Aug 28 16:36:01 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 (f7bfbabd-38a2-4d2b-8ded-8409747d4337): created successfully Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca3ba32-2da0-4900-9cc1-09b8a9a4618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (e0882b80-47dd-4ca3-b0c0-8a9a45698a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6c473272-755f-4bb6-ae53-2bdbb0b684e4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (ce9cbba5-28db-448e-af35-bc80c8efbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161584c-ce39-4d5c-bf9e-ec13b32ae3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161584c-ce39-4d5c-bf9e-ec13b32ae3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-155557082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c706c218-cca2-4aa8-b26f-eaab3fff0dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:02Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e90c5d-efcc-4c39-9baf-9ce3185b943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e90c5d-efcc-4c39-9baf-9ce3185b943b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5226f7b7-a5fc-455e-88f0-bedf8181e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5226f7b7-a5fc-455e-88f0-bedf8181e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c706c218-cca2-4aa8-b26f-eaab3fff0dcf', 'volume_name': 'volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35c7cf9-0479-4b07-b46e-406ea94be33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35c7cf9-0479-4b07-b46e-406ea94be33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28d7f39-b9ec-410f-a1fb-74af152a3ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume c706c218-cca2-4aa8-b26f-eaab3fff0dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf', 'volume_size': 1} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:02 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd 1073741824" returned: 0 in 0.606s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:02 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd Aug 28 16:36:02 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:02 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd" returned: 0 in 0.285s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472533161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84f995d-5952-4ef0-a222-5123b26b1185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:01Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume b84f995d-5952-4ef0-a222-5123b26b1185 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:02 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4b7ed8-0fbd-4d05-9df3-7abda408d083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e99f27-3394-497f-a73b-9d1c7652bccd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 1073741824 Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec47077-ab2d-4447-bbf5-60221c900b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:02 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-a2e99f27-3394-497f-a73b-9d1c7652bccd (a2e99f27-3394-497f-a73b-9d1c7652bccd): created successfully Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec47077-ab2d-4447-bbf5-60221c900b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (2b66da54-9f91-4244-bb13-35e34cd9603e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d72dd0cb-71d4-4638-9359-f2f718f33454 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (83c2a9a5-d921-4468-95c1-259ab5c0a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c504c1-5a6d-4df8-8839-56f6520fe77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c504c1-5a6d-4df8-8839-56f6520fe77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441366790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef2815c-40d0-45d2-8f86-63eb66e02d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:03Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2bc377-c00d-418d-96eb-6b3917248137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:02 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2bc377-c00d-418d-96eb-6b3917248137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa09764-77e9-4a06-bdb8-435e107006f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa09764-77e9-4a06-bdb8-435e107006f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef2815c-40d0-45d2-8f86-63eb66e02d10', 'volume_name': 'volume-fef2815c-40d0-45d2-8f86-63eb66e02d10', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044488ee-1ad0-4205-b2dd-da27f4e552aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (044488ee-1ad0-4205-b2dd-da27f4e552aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0d04d7-e116-4e75-8800-606a084e361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume fef2815c-40d0-45d2-8f86-63eb66e02d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef2815c-40d0-45d2-8f86-63eb66e02d10', 'volume_size': 1} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Flow 'volume_create_manager' (b22674e0-fb15-472c-9ca6-a55d47feaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bffc64d-084f-432b-a1b8-693b6eaea8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bffc64d-084f-432b-a1b8-693b6eaea8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af612cc-5399-4830-bce7-6cec6186bbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e93ff0fda68489a89d6a999d2d79e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:03Z,use_quota=True,user_id='445dfbc63e014309b5685af9af98f425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb8e8181-24a9-4b08-959c-1562d584d136),volume_type_id=eb8e8181-24a9-4b08-959c-1562d584d136)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cde9e9-701e-432c-a46a-d6b767d725d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cde9e9-701e-432c-a46a-d6b767d725d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289573e-cf34-440a-843f-e35d4b9312cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:36:03 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 1073741824" returned: 0 in 0.550s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289573e-cf34-440a-843f-e35d4b9312cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3af612cc-5399-4830-bce7-6cec6186bbea', 'volume_name': 'volume-3af612cc-5399-4830-bce7-6cec6186bbea', 'volume_size': 1, 'image_id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3aef9e75e4a0e563efc46f68af8a53c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e93ff0fda68489a89d6a999d2d79e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d91d2dd136e9fb5040133f23b767b4296a21e184304793d722e7dcd5b72721558f3daf98499caef29b8a8acd758fa940a3fa0674d017b5e269df22bdd1c9e55', 'id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'created_at': datetime.datetime(2026, 8, 28, 14, 35, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ff2517-5521-4451-a1db-beb81d384a90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749302b8-72ba-4cb1-953b-0b65e490928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749302b8-72ba-4cb1-953b-0b65e490928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2f7cdd-0f7f-4778-ae3c-c17b4d6059d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Volume 3af612cc-5399-4830-bce7-6cec6186bbea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3af612cc-5399-4830-bce7-6cec6186bbea', 'volume_size': 1, 'image_id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3aef9e75e4a0e563efc46f68af8a53c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e93ff0fda68489a89d6a999d2d79e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d91d2dd136e9fb5040133f23b767b4296a21e184304793d722e7dcd5b72721558f3daf98499caef29b8a8acd758fa940a3fa0674d017b5e269df22bdd1c9e55', 'id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'created_at': datetime.datetime(2026, 8, 28, 14, 35, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ff2517-5521-4451-a1db-beb81d384a90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 16:36:03 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Trying to clone 3af612cc-5399-4830-bce7-6cec6186bbea from image c2ff2517-5521-4451-a1db-beb81d384a90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:36:03 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Image download 0.00 MB at 0.00 MB/s Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[10469923-d1c4-4bf1-99b9-5eaafdc73546]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:03 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.892s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating offline snapshot 80a16a04-12cc-4500-ae56-6233fc1f5816 of volume 3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176dc8db-4698-4247-9af3-26871bcce110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84f995d-5952-4ef0-a222-5123b26b1185', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb0bac-9ba4-4628-baf4-d6f10f35b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:03 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-b84f995d-5952-4ef0-a222-5123b26b1185 (b84f995d-5952-4ef0-a222-5123b26b1185): created successfully Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb0bac-9ba4-4628-baf4-d6f10f35b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:03 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:03 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (4e253fd1-0fcc-4faa-a145-4a2bcca98b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a36cd8-9fb9-458a-892c-db7e01190943]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-01773d59-b935-4b58-b23c-79a9ecdcdf8a tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:36:03 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c Aug 28 16:36:03 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:04 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:04 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:04 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:04 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:04 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 1G Aug 28 16:36:04 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:04 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Temporary image c2ff2517-5521-4451-a1db-beb81d384a90 is fetched for user 445dfbc63e014309b5685af9af98f425. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[97584b20-6d2c-447e-87f6-41f08dca3b93]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:04 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 1G" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:04 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:04 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:04 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 Aug 28 16:36:04 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:04 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:04 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816" returned: 0 in 0.354s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:04 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 is being set with open permissions: ugo+rw Aug 28 16:36:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:05 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 Aug 28 16:36:05 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:05 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:05 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:05 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816" returned: 0 in 0.306s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:05 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:05 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info Aug 28 16:36:05 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:05 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:05 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info is being set with open permissions: ugo+rw Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:05 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info Aug 28 16:36:05 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:05 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.info" returned: 0 in 0.267s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.625s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-155557082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c706c218-cca2-4aa8-b26f-eaab3fff0dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:02Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume c706c218-cca2-4aa8-b26f-eaab3fff0dcf {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:05 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf 1073741824 Aug 28 16:36:05 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e8a53916-98ad-4cb3-ada3-01c769ada29c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Create snapshot completed successfully Aug 28 16:36:06 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf 1073741824" returned: 0 in 0.487s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:06 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf Aug 28 16:36:06 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:06 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" returned: 0 in 0.279s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.685s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441366790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef2815c-40d0-45d2-8f86-63eb66e02d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b968890255f4083ad32d72d81b6ed75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:03Z,use_quota=True,user_id='35acbfa543f64f01a1a3e62ea2cf713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Creating volume fef2815c-40d0-45d2-8f86-63eb66e02d10 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:06 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:06 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 1073741824 Aug 28 16:36:06 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d28d7f39-b9ec-410f-a1fb-74af152a3ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0f699-8707-4997-b97a-ec911a1118aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf (c706c218-cca2-4aa8-b26f-eaab3fff0dcf): created successfully Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0f699-8707-4997-b97a-ec911a1118aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (ce9cbba5-28db-448e-af35-bc80c8efbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d1ffa22c-a983-4512-922a-1a6423834fb4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:36:07 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 1073741824" returned: 0 in 0.655s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:07 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 Aug 28 16:36:07 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (6798c2f5-152f-455c-b919-b4904c79b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499b2cb5-46cf-4649-b88c-07116cb83cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499b2cb5-46cf-4649-b88c-07116cb83cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748559216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19fcea-b87e-40f5-9c96-07712f5e78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:08Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcf0d87-37c3-453e-8472-7b1401274f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcf0d87-37c3-453e-8472-7b1401274f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a6c5a8-3b28-4d6a-80c7-497069f7c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a6c5a8-3b28-4d6a-80c7-497069f7c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b19fcea-b87e-40f5-9c96-07712f5e78d4', 'volume_name': 'volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a10e588-ba8d-4a32-80fc-02a4cccb1c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a10e588-ba8d-4a32-80fc-02a4cccb1c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21edd985-5150-44b4-b37d-4f2090fb1e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume 3b19fcea-b87e-40f5-9c96-07712f5e78d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4', 'volume_size': 1} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:07 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10" returned: 0 in 0.400s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af612cc-5399-4830-bce7-6cec6186bbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e93ff0fda68489a89d6a999d2d79e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:03Z,use_quota=True,user_id='445dfbc63e014309b5685af9af98f425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb8e8181-24a9-4b08-959c-1562d584d136),volume_type_id=eb8e8181-24a9-4b08-959c-1562d584d136)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Creating volume 3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:07 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0d04d7-e116-4e75-8800-606a084e361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef2815c-40d0-45d2-8f86-63eb66e02d10', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1073741824 Aug 28 16:36:07 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4f24ea-28df-4e88-92b9-6262d2a75d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:07 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Volume volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 (fef2815c-40d0-45d2-8f86-63eb66e02d10): created successfully Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4f24ea-28df-4e88-92b9-6262d2a75d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:07 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Flow 'volume_create_manager' (83c2a9a5-d921-4468-95c1-259ab5c0a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3e7a80f3-f77c-4128-a046-e4e898279dde tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created volume successfully. Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (addeccc2-219e-4119-b1dc-ffdd258e7105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcdbcde-7718-4cb8-930c-3df42948e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcdbcde-7718-4cb8-930c-3df42948e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389573012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:08Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aab9c7-dad7-454a-a416-501985522039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aab9c7-dad7-454a-a416-501985522039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0758e54-2d85-4f53-851f-c02e0acc4e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0758e54-2d85-4f53-851f-c02e0acc4e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5', 'volume_name': 'volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50347ca5-51ea-49ed-a559-1382e1fe0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50347ca5-51ea-49ed-a559-1382e1fe0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6145f-ed26-45d0-a7df-96afda3134c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume 0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5', 'volume_size': 1} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:08 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1073741824" returned: 0 in 0.626s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-fef2815c-40d0-45d2-8f86-63eb66e02d10-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-fef2815c-40d0-45d2-8f86-63eb66e02d10-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:08 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea Aug 28 16:36:08 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-fef2815c-40d0-45d2-8f86-63eb66e02d10" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-fef2815c-40d0-45d2-8f86-63eb66e02d10" acquired by "delete_volume" :: waited 0.053s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab8e797-2053-4d9a-9b1e-391e7c1bbd41]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (d88cf034-aa77-4cb1-a4f9-6c11bc51d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2431e471-2cec-441d-96ff-8afa4426eb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2431e471-2cec-441d-96ff-8afa4426eb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767354968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe711f2-b5e1-4177-b8ec-238cf0819117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:09Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7602e328-20b1-433a-be14-c628147627ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7602e328-20b1-433a-be14-c628147627ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 Aug 28 16:36:09 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1fabf3-9d92-4df3-b50b-6246a58832a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1fabf3-9d92-4df3-b50b-6246a58832a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe711f2-b5e1-4177-b8ec-238cf0819117', 'volume_name': 'volume-1fe711f2-b5e1-4177-b8ec-238cf0819117', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f64e87-2d0d-4722-ab4c-5e6fe6de34ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f64e87-2d0d-4722-ab4c-5e6fe6de34ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb2b9c-36cd-4f97-9140-168af9d99295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume 1fe711f2-b5e1-4177-b8ec-238cf0819117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe711f2-b5e1-4177-b8ec-238cf0819117', 'volume_size': 1} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea" returned: 0 in 0.561s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748559216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19fcea-b87e-40f5-9c96-07712f5e78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:08Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume 3b19fcea-b87e-40f5-9c96-07712f5e78d4 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:09 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:09 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 1073741824 Aug 28 16:36:09 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Attempting download of c2ff2517-5521-4451-a1db-beb81d384a90 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}])) to volume 3af612cc-5399-4830-bce7-6cec6186bbea. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[75362498-267f-478b-ae52-1403483de787]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:09 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt Aug 28 16:36:09 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:09 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10" returned: 0 in 0.750s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:09 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10 Aug 28 16:36:09 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (7ea2aa6f-0eba-49d3-9a37-b37b34e20476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754022c-7ec5-4840-a6cd-4bb535052c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1754022c-7ec5-4840-a6cd-4bb535052c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766750592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3568cc78-6628-46a7-ac2d-d904058950fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:10Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0af3e8-1be5-4d94-890a-9b6cf606dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0af3e8-1be5-4d94-890a-9b6cf606dc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caac2f8-91f6-4815-bf06-6c2dd0cef9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caac2f8-91f6-4815-bf06-6c2dd0cef9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3568cc78-6628-46a7-ac2d-d904058950fe', 'volume_name': 'volume-3568cc78-6628-46a7-ac2d-d904058950fe', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70debf3-0993-42dd-b584-90a593256b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70debf3-0993-42dd-b584-90a593256b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfbe08d-03d9-4707-8b3f-c616a3d01a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:09 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume 3568cc78-6628-46a7-ac2d-d904058950fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3568cc78-6628-46a7-ac2d-d904058950fe', 'volume_size': 1} Aug 28 16:36:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:10 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt" returned: 0 in 0.619s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:10 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 1073741824" returned: 0 in 0.848s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:10 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 Aug 28 16:36:10 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:10 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-fef2815c-40d0-45d2-8f86-63eb66e02d10" returned: 0 in 0.540s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-fef2815c-40d0-45d2-8f86-63eb66e02d10" released by "delete_volume" :: held 1.391s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:10 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt Aug 28 16:36:10 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['20c5523d-5f71-4ec1-906c-4eba603787a4', 'fd06b23e-d8fc-4527-bb1b-729365075a5c', 'd53ffcfe-6b18-4a21-83bf-a8f6f7824f96', '4308ec58-3246-4198-bcb4-b086ebe42423'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (1b4478ff-246c-438b-80eb-61e709980411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285d1740-6168-4e6a-815a-c45bf7b51e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285d1740-6168-4e6a-815a-c45bf7b51e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088881828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce398adf-c532-4bcb-838c-917c6087a2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:10Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d4430-3b14-46bc-8bd6-066e013aa72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (371d4430-3b14-46bc-8bd6-066e013aa72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac913efc-4e28-4531-bdbe-5554860e130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac913efc-4e28-4531-bdbe-5554860e130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce398adf-c532-4bcb-838c-917c6087a2cf', 'volume_name': 'volume-ce398adf-c532-4bcb-838c-917c6087a2cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe757348-ec55-4329-ae72-8c9af21985b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe757348-ec55-4329-ae72-8c9af21985b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fbea23-c242-4906-b143-e952df4b1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume ce398adf-c532-4bcb-838c-917c6087a2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce398adf-c532-4bcb-838c-917c6087a2cf', 'volume_size': 1} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1389573012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:08Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume 0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:10 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:10 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt" returned: 1 in 0.555s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2ff2517-5521-4451-a1db-beb81d384a90_1gfolnwt' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:10 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 1073741824 Aug 28 16:36:10 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a5fb15-9b90-4efb-b58a-d746f2b8cf19]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21edd985-5150-44b4-b37d-4f2090fb1e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:10 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fcc51-d3f3-4818-8f9d-eb748db3a66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 (3b19fcea-b87e-40f5-9c96-07712f5e78d4): created successfully Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fcc51-d3f3-4818-8f9d-eb748db3a66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (6798c2f5-152f-455c-b919-b4904c79b460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c7642d87-63e8-410d-8411-8434f9544a25 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:10 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:10 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:10 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b0d77b3b-a94b-437b-953e-c75bfcfb3460 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-fef2815c-40d0-45d2-8f86-63eb66e02d10-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:11 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-c706c218-cca2-4aa8-b26f-eaab3fff0dcf-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-c706c218-cca2-4aa8-b26f-eaab3fff0dcf-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:11 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 1073741824" returned: 0 in 0.702s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:11 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD Aug 28 16:36:11 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad54d7-20cf-4105-8dfe-6a20e3a6d4bb]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 Aug 28 16:36:11 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:11 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf Aug 28 16:36:11 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:11 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] c2ff2517-5521-4451-a1db-beb81d384a90 was raw, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea Aug 28 16:36:11 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:11 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767354968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe711f2-b5e1-4177-b8ec-238cf0819117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:09Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume 1fe711f2-b5e1-4177-b8ec-238cf0819117 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6145f-ed26-45d0-a7df-96afda3134c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b9d3e2-07fc-4869-8152-37f9d4c572d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:11 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 1073741824 Aug 28 16:36:11 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 (0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5): created successfully Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b9d3e2-07fc-4869-8152-37f9d4c572d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (addeccc2-219e-4119-b1dc-ffdd258e7105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7a1f66bb-382d-45cb-a3be-88013639f09e tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:11 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" returned: 0 in 0.457s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:11 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf Aug 28 16:36:11 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" returned: 0 in 0.288s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-c706c218-cca2-4aa8-b26f-eaab3fff0dcf" released by "delete_volume" :: held 0.834s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:12 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea" returned: 0 in 0.558s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2ff2517-5521-4451-a1db-beb81d384a90_o_c77m3mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:36:12 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:12 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1G Aug 28 16:36:12 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['3e2d5aa4-6d0d-4d4a-b6a1-4ee71ef816ca', 'aaf9576e-83a9-4595-b804-f0a01308b5fc', 'f63a7c5e-73b9-410d-b896-ca7618259e79', '20d3aa27-358b-453a-ad54-4f5e20d85236'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:12 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 1073741824" returned: 0 in 0.586s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:12 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 Aug 28 16:36:12 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-b84f995d-5952-4ef0-a222-5123b26b1185-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:12 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:12 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-b84f995d-5952-4ef0-a222-5123b26b1185-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-b84f995d-5952-4ef0-a222-5123b26b1185" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-b84f995d-5952-4ef0-a222-5123b26b1185" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcaf5bd-3563-4a1a-9cc7-6b2d08603c7c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:12 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea 1G" returned: 0 in 0.579s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Downloaded image c2ff2517-5521-4451-a1db-beb81d384a90 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}])) to volume 3af612cc-5399-4830-bce7-6cec6186bbea successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Temporary image c2ff2517-5521-4451-a1db-beb81d384a90 for user 445dfbc63e014309b5685af9af98f425 is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Marking volume 3af612cc-5399-4830-bce7-6cec6186bbea as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Copying metadata from image c2ff2517-5521-4451-a1db-beb81d384a90 to 3af612cc-5399-4830-bce7-6cec6186bbea. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Creating volume glance metadata for volume 3af612cc-5399-4830-bce7-6cec6186bbea backed by image c2ff2517-5521-4451-a1db-beb81d384a90 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3aef9e75e4a0e563efc46f68af8a53c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:36:12 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117" returned: 0 in 0.547s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-766750592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3568cc78-6628-46a7-ac2d-d904058950fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:10Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume 3568cc78-6628-46a7-ac2d-d904058950fe {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:12 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:12 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 Aug 28 16:36:12 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccb2b9c-36cd-4f97-9140-168af9d99295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe711f2-b5e1-4177-b8ec-238cf0819117', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:12 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe 1073741824 Aug 28 16:36:12 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54955b0-07f5-4a3d-b699-2624f25ab499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:13 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.596s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:13 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 (1fe711f2-b5e1-4177-b8ec-238cf0819117): created successfully Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54955b0-07f5-4a3d-b699-2624f25ab499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (d88cf034-aa77-4cb1-a4f9-6c11bc51d576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2f7cdd-0f7f-4778-ae3c-c17b4d6059d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af612cc-5399-4830-bce7-6cec6186bbea', 'volume_size': 1, 'image_id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2ff2517-5521-4451-a1db-beb81d384a90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3aef9e75e4a0e563efc46f68af8a53c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e93ff0fda68489a89d6a999d2d79e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d91d2dd136e9fb5040133f23b767b4296a21e184304793d722e7dcd5b72721558f3daf98499caef29b8a8acd758fa940a3fa0674d017b5e269df22bdd1c9e55', 'id': 'c2ff2517-5521-4451-a1db-beb81d384a90', 'created_at': datetime.datetime(2026, 8, 28, 14, 35, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2ff2517-5521-4451-a1db-beb81d384a90/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eee53c-31cb-488d-a462-30b95d5915be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a2d75f89-1a1a-459c-8cf1-d66b02ddf492 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b02e959c-ab66-4a9b-acc5-803b0037eaa4 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-c706c218-cca2-4aa8-b26f-eaab3fff0dcf-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:13 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Volume volume-3af612cc-5399-4830-bce7-6cec6186bbea (3af612cc-5399-4830-bce7-6cec6186bbea): created successfully Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eee53c-31cb-488d-a462-30b95d5915be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Flow 'volume_create_manager' (b22674e0-fb15-472c-9ca6-a55d47feaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d1e94242-c192-4d11-b6a1-99081acfc72f tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Created volume successfully. Aug 28 16:36:13 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185" returned: 0 in 0.672s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:13 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185 Aug 28 16:36:13 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:13 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe 1073741824" returned: 0 in 0.570s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:13 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe Aug 28 16:36:13 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:13 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b84f995d-5952-4ef0-a222-5123b26b1185" returned: 0 in 0.331s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-b84f995d-5952-4ef0-a222-5123b26b1185" released by "delete_volume" :: held 1.086s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['f0348d4c-8253-48fa-bb3d-b5cd4c9e33c2', 'd7e2bbd0-8e82-4fbe-b6d0-c7c753bf1996', 'd09d04cb-83aa-416f-8730-6e2caf393673', '72de3ba0-35f6-421d-8f6e-99e7548464ed'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Acquiring lock "cinder-3af612cc-5399-4830-bce7-6cec6186bbea-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:13 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe" returned: 0 in 0.421s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "cinder-3af612cc-5399-4830-bce7-6cec6186bbea-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.442s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088881828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce398adf-c532-4bcb-838c-917c6087a2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d683f7cbf7c1486ab114f8a826d6d5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:10Z,use_quota=True,user_id='d807bd00e4c34b4a85292e23c48a0be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:13 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Creating volume ce398adf-c532-4bcb-838c-917c6087a2cf {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:13 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfbe08d-03d9-4707-8b3f-c616a3d01a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3568cc78-6628-46a7-ac2d-d904058950fe', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb853be-1a86-48d8-913f-d3147278d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:14 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf 1073741824 Aug 28 16:36:14 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-3568cc78-6628-46a7-ac2d-d904058950fe (3568cc78-6628-46a7-ac2d-d904058950fe): created successfully Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb853be-1a86-48d8-913f-d3147278d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (7ea2aa6f-0eba-49d3-9a37-b37b34e20476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-91710405-6978-415f-b24c-170bc4950f3c tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Acquiring lock "cinder-quobyte-3af612cc-5399-4830-bce7-6cec6186bbea" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "cinder-quobyte-3af612cc-5399-4830-bce7-6cec6186bbea" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cddc66a-298a-4b40-9717-1f40d2509ca5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:14 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-3ba31771-9d7f-49ce-93ec-bf6ba2ae9c87 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-b84f995d-5952-4ef0-a222-5123b26b1185-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:14 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea Aug 28 16:36:14 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:14 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf 1073741824" returned: 0 in 0.563s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:14 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf Aug 28 16:36:14 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:14 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea" returned: 0 in 0.427s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:14 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea Aug 28 16:36:14 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:14 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf" returned: 0 in 0.281s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fbea23-c242-4906-b143-e952df4b1631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce398adf-c532-4bcb-838c-917c6087a2cf', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec02f4b-4deb-4428-8565-bfb55a167fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Volume volume-ce398adf-c532-4bcb-838c-917c6087a2cf (ce398adf-c532-4bcb-838c-917c6087a2cf): created successfully Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec02f4b-4deb-4428-8565-bfb55a167fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Flow 'volume_create_manager' (1b4478ff-246c-438b-80eb-61e709980411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d2d4f632-a959-4837-b39c-734d43770e76 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created volume successfully. Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-a2e99f27-3394-497f-a73b-9d1c7652bccd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-a2e99f27-3394-497f-a73b-9d1c7652bccd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:15 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3af612cc-5399-4830-bce7-6cec6186bbea" returned: 0 in 0.357s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "cinder-quobyte-3af612cc-5399-4830-bce7-6cec6186bbea" released by "delete_volume" :: held 0.855s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-a2e99f27-3394-497f-a73b-9d1c7652bccd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-a2e99f27-3394-497f-a73b-9d1c7652bccd" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671ad0e-addb-4bd4-86e4-d89d4683be55]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Created reservations ['acdeddff-fef2-4478-8ec6-ea740836063b', '124ff919-62c9-4de3-a227-92ffd0debb11', '9ce722e8-317f-442c-a44b-3b7f042f3eaa', 'e9d4b120-d4ee-46b6-938d-b183b580fe7a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:15 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd Aug 28 16:36:15 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:15 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:15 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-ce398adf-c532-4bcb-838c-917c6087a2cf-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-ce398adf-c532-4bcb-838c-917c6087a2cf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-ce398adf-c532-4bcb-838c-917c6087a2cf" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-ce398adf-c532-4bcb-838c-917c6087a2cf" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba244985-354c-419b-8e20-e35a7418f298]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:15 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Deleted volume successfully. Aug 28 16:36:15 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd" returned: 0 in 0.593s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-dcf35dd1-e25d-47f3-9eb8-f3a2f38fa4e7 tempest-VolumeAndVolumeTypeFromImageTest-1052411569 None] Lock "cinder-3af612cc-5399-4830-bce7-6cec6186bbea-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:15 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd Aug 28 16:36:15 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:15 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf Aug 28 16:36:15 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:16 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2e99f27-3394-497f-a73b-9d1c7652bccd" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-a2e99f27-3394-497f-a73b-9d1c7652bccd" released by "delete_volume" :: held 0.954s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:16 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf" returned: 0 in 0.486s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['9aa48e8e-bf27-4a24-bdc1-3b20773388d8', 'f44bd586-aac8-483d-8259-ae7ce105fe4c', 'a3f8f2bc-d476-4c95-9a38-5ed3ad4cf2fd', '20857976-fe0e-4571-9251-e7fd7d75ffe5'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:16 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf Aug 28 16:36:16 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:16 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:16 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:16 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-ce398adf-c532-4bcb-838c-917c6087a2cf" returned: 0 in 0.320s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-ce398adf-c532-4bcb-838c-917c6087a2cf" released by "delete_volume" :: held 0.880s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['3bd5c103-ab9f-4039-a578-3057fca71966', '62c70145-9219-42fe-9dec-d1f5be9a8636', '3e67289e-8f33-470d-8851-0277bf737793', 'b0a60f67-45b2-4106-a41f-5b4610248f4d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:16 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2fc0489-998a-4c12-91e5-d29203a5e665 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-a2e99f27-3394-497f-a73b-9d1c7652bccd-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-3568cc78-6628-46a7-ac2d-d904058950fe-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:16 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:16 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3568cc78-6628-46a7-ac2d-d904058950fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-3568cc78-6628-46a7-ac2d-d904058950fe" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3568cc78-6628-46a7-ac2d-d904058950fe" acquired by "delete_volume" :: waited 0.036s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6406f81-bf64-4468-bd0e-14d0635d3290]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:17 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe Aug 28 16:36:17 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:17 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8256685b-81b3-488d-a7ce-7b79f326b667 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-ce398adf-c532-4bcb-838c-917c6087a2cf-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-f7bfbabd-38a2-4d2b-8ded-8409747d4337-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-f7bfbabd-38a2-4d2b-8ded-8409747d4337-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:17 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe" returned: 0 in 0.464s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:17 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe Aug 28 16:36:17 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-f7bfbabd-38a2-4d2b-8ded-8409747d4337" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-f7bfbabd-38a2-4d2b-8ded-8409747d4337" acquired by "delete_volume" :: waited 0.044s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e760b-2e06-494f-8334-640bdf38f4c3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:17 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 Aug 28 16:36:17 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:17 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3568cc78-6628-46a7-ac2d-d904058950fe" returned: 0 in 0.437s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3568cc78-6628-46a7-ac2d-d904058950fe" released by "delete_volume" :: held 0.969s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['43c15fe6-891b-4375-a3de-acd044afc926', 'f6b93ab2-d38f-4a7c-900a-a41dd0a924f7', '80f86d2d-7301-41e9-bb01-a326496d6507', '7e7ad69e-965d-4cee-9f8c-68245fcd667f'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:18 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337" returned: 0 in 0.546s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:18 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:18 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:18 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337 Aug 28 16:36:18 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:18 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.373s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:18 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c64052bf-c451-4f18-917d-770c80ff7225 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3568cc78-6628-46a7-ac2d-d904058950fe-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:18 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f7bfbabd-38a2-4d2b-8ded-8409747d4337" returned: 0 in 0.472s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-f7bfbabd-38a2-4d2b-8ded-8409747d4337" released by "delete_volume" :: held 1.094s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['546a6094-5ae8-4d6d-af50-a1af0713dad4', '5bf90272-6a3b-4bcd-a156-06047d34a2bb', 'f74049f5-be75-46bc-9a01-2aa6366aac27', 'e69afb7b-df93-42cf-afbf-9f6ed3491270'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:18 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:18 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:19 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-da89bb10-9b31-427a-b019-23992a77b3b0 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-f7bfbabd-38a2-4d2b-8ded-8409747d4337-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-1fe711f2-b5e1-4177-b8ec-238cf0819117-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-1fe711f2-b5e1-4177-b8ec-238cf0819117-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-1fe711f2-b5e1-4177-b8ec-238cf0819117" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-1fe711f2-b5e1-4177-b8ec-238cf0819117" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[88084f0a-9186-4371-a9fb-c56674fcdba2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:19 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 Aug 28 16:36:19 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:19 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117" returned: 0 in 0.477s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:19 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117 Aug 28 16:36:19 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-a8c3fc35-05d3-46be-bdb2-ced5f3e19432-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-a8c3fc35-05d3-46be-bdb2-ced5f3e19432-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "cinder-quobyte-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef5d10-bacf-4e6f-b13d-629be4378964]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:20 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1fe711f2-b5e1-4177-b8ec-238cf0819117" returned: 0 in 0.381s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-1fe711f2-b5e1-4177-b8ec-238cf0819117" released by "delete_volume" :: held 0.914s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:20 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 Aug 28 16:36:20 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['3c3a33ba-8294-45f7-b581-272fca52eed4', '9239ec43-d27a-41b6-811a-cab92de4f476', 'fbe738e2-9ad5-4f13-8053-d64a4fd8a95f', 'd31f6a8b-4498-40fb-af5a-55d3a4891a12'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:20 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:20 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:20 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" returned: 0 in 0.524s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:20 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432 Aug 28 16:36:20 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:20 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.343s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:20 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a084a9a0-0ca3-48df-935d-ff15326dc629 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-1fe711f2-b5e1-4177-b8ec-238cf0819117-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:20 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-quobyte-a8c3fc35-05d3-46be-bdb2-ced5f3e19432" released by "delete_volume" :: held 0.944s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Created reservations ['e2f1f438-7e3a-4664-bfc2-6bdfeeaf46ad', '33e48126-e6b5-4317-8bd6-ede735f855bd', '4aeae819-3320-4f13-9b6c-e827f74ec6ab', '92a80898-ba2f-47f7-94a3-1bdade83b2a4'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:21 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:21 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:21 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Deleted volume successfully. Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-cf6be79b-5fff-4397-8ed2-8b8ce9d38720 tempest-CreateVolumesFromSourceVolumeTest-975644166 None] Lock "cinder-a8c3fc35-05d3-46be-bdb2-ced5f3e19432-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fa5ba-ab0a-4ca7-b61d-d83c8f35d80b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:21 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 Aug 28 16:36:21 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:22 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" returned: 0 in 0.503s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:22 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5 Aug 28 16:36:22 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:22 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" returned: 0 in 0.406s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5" released by "delete_volume" :: held 0.985s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['bdcd7474-a1a0-403b-bea2-07fae51d3cd2', 'f561e904-2acf-42c9-a4ca-965f1bbe4409', 'cc03a26a-1d2c-478e-97e5-e7c056331161', '14294efd-7173-4d6d-8e74-4aea82e3913a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:23 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:23 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (e8423953-2915-4e0d-a1e6-bf5d48609f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a68bfdd-e440-4f4c-b3e5-bfbc211169e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a68bfdd-e440-4f4c-b3e5-bfbc211169e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251136153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2892f124-2f1e-41d3-ba2d-5c76dc883607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:23Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2262d825-bb07-493c-a75d-b63f27f4e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2262d825-bb07-493c-a75d-b63f27f4e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d768cd4-9472-4d75-b2a4-b159632f84c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d768cd4-9472-4d75-b2a4-b159632f84c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2892f124-2f1e-41d3-ba2d-5c76dc883607', 'volume_name': 'volume-2892f124-2f1e-41d3-ba2d-5c76dc883607', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3fd511-5f3e-4799-99e4-e84f600f3237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3fd511-5f3e-4799-99e4-e84f600f3237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d30de57-cbdb-4ed8-9939-1e1107c6e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Volume 2892f124-2f1e-41d3-ba2d-5c76dc883607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2892f124-2f1e-41d3-ba2d-5c76dc883607', 'volume_size': 1} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251136153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2892f124-2f1e-41d3-ba2d-5c76dc883607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:23Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Creating volume 2892f124-2f1e-41d3-ba2d-5c76dc883607 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:23 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:23 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 1073741824 Aug 28 16:36:23 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:23 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.585s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:23 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (36da9a20-a590-4187-b18b-67cb2399ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabdecf6-2bef-4cce-98da-5f0a703ec86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d8e8c303-ecf8-4984-8e42-fd8a6a84cd64 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-0cd8a91a-21ce-483b-a5bc-a1cdf1225ab5-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabdecf6-2bef-4cce-98da-5f0a703ec86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852549823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894a0475-4de0-4580-ae2c-fe82a17659cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:23Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8505e26b-4a0b-471d-aa4d-3806d56b34e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8505e26b-4a0b-471d-aa4d-3806d56b34e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a64bc-2ddc-4741-be03-1a795c58f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a64bc-2ddc-4741-be03-1a795c58f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894a0475-4de0-4580-ae2c-fe82a17659cd', 'volume_name': 'volume-894a0475-4de0-4580-ae2c-fe82a17659cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155712ed-b682-4502-a15e-86e590c9b9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155712ed-b682-4502-a15e-86e590c9b9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285a0d81-b09f-49fc-b03d-be32e6435284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:23 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Volume 894a0475-4de0-4580-ae2c-fe82a17659cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894a0475-4de0-4580-ae2c-fe82a17659cd', 'volume_size': 1} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-3b19fcea-b87e-40f5-9c96-07712f5e78d4-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3b19fcea-b87e-40f5-9c96-07712f5e78d4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:24 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 1073741824" returned: 0 in 0.807s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-3b19fcea-b87e-40f5-9c96-07712f5e78d4" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3b19fcea-b87e-40f5-9c96-07712f5e78d4" acquired by "delete_volume" :: waited 0.067s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:24 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 Aug 28 16:36:24 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e363249-e023-41e7-a297-6731447c5881]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (0b7e9318-218a-4914-8a8f-f61e71dc3269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e416cd3e-467d-4d1f-b517-386fd05f17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 Aug 28 16:36:24 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e416cd3e-467d-4d1f-b517-386fd05f17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021618620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ca21f-47f5-4391-b7ee-442d1542ae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:24Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38e4bc-4372-4d8a-8c2c-f09364b539a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38e4bc-4372-4d8a-8c2c-f09364b539a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cb2f88-bf4b-4b5d-9e9d-daf835ac7f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cb2f88-bf4b-4b5d-9e9d-daf835ac7f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9ca21f-47f5-4391-b7ee-442d1542ae9c', 'volume_name': 'volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf39f4-c7d7-433f-a371-6ce80aa3d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcf39f4-c7d7-433f-a371-6ce80aa3d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583c95ce-e2c5-476a-a664-c7456c4345b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Volume 4c9ca21f-47f5-4391-b7ee-442d1542ae9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c', 'volume_size': 1} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607" returned: 0 in 0.448s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852549823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894a0475-4de0-4580-ae2c-fe82a17659cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:23Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Creating volume 894a0475-4de0-4580-ae2c-fe82a17659cd {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:24 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:24 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd 1073741824 Aug 28 16:36:24 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d30de57-cbdb-4ed8-9939-1e1107c6e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2892f124-2f1e-41d3-ba2d-5c76dc883607', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93786cbb-6d29-457c-ba04-20c320b8e224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:24 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Volume volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 (2892f124-2f1e-41d3-ba2d-5c76dc883607): created successfully Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93786cbb-6d29-457c-ba04-20c320b8e224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (e8423953-2915-4e0d-a1e6-bf5d48609f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-31690d08-8a15-4727-807f-37c1ac4f7371 tempest-CreateVolumesFromImageTest-737433471 None] Created volume successfully. Aug 28 16:36:24 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4" returned: 0 in 0.738s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:25 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4 Aug 28 16:36:25 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (ffca3f93-640b-489a-a50e-1a26cb25adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e6b3a-5437-4e32-9e15-b916fd4d4520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5e6b3a-5437-4e32-9e15-b916fd4d4520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1186394585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950efd3c-5b5a-4a4f-b659-7f63e112dc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:25Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70befa0b-b9d5-4410-bab5-4d36970fd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70befa0b-b9d5-4410-bab5-4d36970fd377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600b813-ce74-4900-87b7-60a4411152bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a600b813-ce74-4900-87b7-60a4411152bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950efd3c-5b5a-4a4f-b659-7f63e112dc57', 'volume_name': 'volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd57a824-556f-4584-9366-9028723ab0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd57a824-556f-4584-9366-9028723ab0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a7b1d8-b629-445c-b6dc-f6a9dcdc44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Volume 950efd3c-5b5a-4a4f-b659-7f63e112dc57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57', 'volume_size': 1} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:25 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd 1073741824" returned: 0 in 0.926s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:25 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3b19fcea-b87e-40f5-9c96-07712f5e78d4" returned: 0 in 0.540s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3b19fcea-b87e-40f5-9c96-07712f5e78d4" released by "delete_volume" :: held 1.427s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:25 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd Aug 28 16:36:25 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (77e1d81a-5624-4bc0-a174-c42f1ac22471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85230d5b-3782-48d8-b959-2b413085e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['3e63cc2a-e693-4baf-865d-38130dbd75ee', 'f220ec28-9170-4dcd-abcc-a46a598be9a5', '18f19e99-bcab-458e-9712-6f5ff44c3a07', 'b44d67e4-5e25-4a85-9f52-780338056adf'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85230d5b-3782-48d8-b959-2b413085e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343320946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0228b8-9783-4267-b1b7-30b5d7485737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:26Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332ef82f-2cd5-40da-853e-10d0490c51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332ef82f-2cd5-40da-853e-10d0490c51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ba89f3-2d33-4577-b04e-d49286b623fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ba89f3-2d33-4577-b04e-d49286b623fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0228b8-9783-4267-b1b7-30b5d7485737', 'volume_name': 'volume-8e0228b8-9783-4267-b1b7-30b5d7485737', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc15215-11de-4614-a711-1a79a96d6bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc15215-11de-4614-a711-1a79a96d6bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdcf643-e2c7-4f07-9e68-698993f13eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Volume 8e0228b8-9783-4267-b1b7-30b5d7485737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0228b8-9783-4267-b1b7-30b5d7485737', 'volume_size': 1} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:25 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:25 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:26 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd" returned: 0 in 0.410s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021618620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ca21f-47f5-4391-b7ee-442d1542ae9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:24Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Creating volume 4c9ca21f-47f5-4391-b7ee-442d1542ae9c {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:26 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285a0d81-b09f-49fc-b03d-be32e6435284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894a0475-4de0-4580-ae2c-fe82a17659cd', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffcdf91-cb1d-413c-8887-9e7f5eb686c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:26 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c 1073741824 Aug 28 16:36:26 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Volume volume-894a0475-4de0-4580-ae2c-fe82a17659cd (894a0475-4de0-4580-ae2c-fe82a17659cd): created successfully Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ffcdf91-cb1d-413c-8887-9e7f5eb686c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (36da9a20-a590-4187-b18b-67cb2399ec40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1d060de6-4d1e-4c24-90ab-462ac1367e17 tempest-CreateVolumesFromImageTest-737433471 None] Created volume successfully. Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-80a16a04-12cc-4500-ae56-6233fc1f5816-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-80a16a04-12cc-4500-ae56-6233fc1f5816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-80a16a04-12cc-4500-ae56-6233fc1f5816" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:26 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.495s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-80a16a04-12cc-4500-ae56-6233fc1f5816" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleting offline snapshot 80a16a04-12cc-4500-ae56-6233fc1f5816 of volume 3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] snapshot_file for this snap is: volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef63f7-25aa-4caf-a163-973347f9c5a9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-18174a07-8cbe-42b2-8ea0-440623c5c297 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3b19fcea-b87e-40f5-9c96-07712f5e78d4-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:26 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 Aug 28 16:36:26 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:26 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c 1073741824" returned: 0 in 0.724s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:26 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c Aug 28 16:36:26 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:27 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816" returned: 0 in 0.505s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e8da5-06cf-4161-92d8-4e800dc92c54]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:27 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c Aug 28 16:36:27 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:27 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" returned: 0 in 0.371s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1186394585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950efd3c-5b5a-4a4f-b659-7f63e112dc57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:25Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Creating volume 950efd3c-5b5a-4a4f-b659-7f63e112dc57 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:27 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583c95ce-e2c5-476a-a664-c7456c4345b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:27 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 1073741824 Aug 28 16:36:27 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9cffe0-b73e-4040-bf1e-192cfcbba4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:27 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Volume volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c (4c9ca21f-47f5-4391-b7ee-442d1542ae9c): created successfully Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9cffe0-b73e-4040-bf1e-192cfcbba4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (0b7e9318-218a-4914-8a8f-f61e71dc3269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7e41928b-2929-4034-80d0-2fd28526ed76 tempest-CreateVolumesFromImageTest-737433471 None] Created volume successfully. Aug 28 16:36:27 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" returned: 0 in 0.629s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:27 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 Aug 28 16:36:27 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:28 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 1073741824" returned: 0 in 0.788s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:28 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 Aug 28 16:36:28 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:28 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816" returned: 0 in 0.558s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:28 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816 Aug 28 16:36:28 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:28 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57" returned: 0 in 0.455s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.744s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343320946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0228b8-9783-4267-b1b7-30b5d7485737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678331abfee24854b1952f7bfe02d73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:26Z,use_quota=True,user_id='7726fe28d14f4304804fc4ef1860e3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Creating volume 8e0228b8-9783-4267-b1b7-30b5d7485737 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:28 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:28 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a7b1d8-b629-445c-b6dc-f6a9dcdc44ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:28 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 1073741824 Aug 28 16:36:28 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5acc3b-ef96-46e0-8b27-348a072aa1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c.80a16a04-12cc-4500-ae56-6233fc1f5816" returned: 0 in 0.394s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Volume volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 (950efd3c-5b5a-4a4f-b659-7f63e112dc57): created successfully Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5acc3b-ef96-46e0-8b27-348a072aa1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (ffca3f93-640b-489a-a50e-1a26cb25adf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-80a16a04-12cc-4500-ae56-6233fc1f5816" released by "_delete_snapshot" :: held 2.271s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ce6ec65a-452e-4464-8bd5-af5a37a1175d tempest-CreateVolumesFromImageTest-737433471 None] Created volume successfully. Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" released by "delete_snapshot" :: held 2.327s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['16649008-e187-43e5-a190-8057c14ef0d9', 'd6a7315e-34b9-4b83-8a37-73d44a8b2fbe', '3e1c3f5d-023d-41da-adcf-f8e263f0e142', '5ba4de9b-c133-416d-bb5f-0ad13e6b5614'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Delete snapshot completed successfully. Aug 28 16:36:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325009d9-1a68-4380-998f-613c86baf3f2 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-80a16a04-12cc-4500-ae56-6233fc1f5816-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:29 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 1073741824" returned: 0 in 0.622s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:29 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 Aug 28 16:36:29 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:29 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdcf643-e2c7-4f07-9e68-698993f13eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0228b8-9783-4267-b1b7-30b5d7485737', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f374c-4655-4d86-990f-113fd45c6eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Volume volume-8e0228b8-9783-4267-b1b7-30b5d7485737 (8e0228b8-9783-4267-b1b7-30b5d7485737): created successfully Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f374c-4655-4d86-990f-113fd45c6eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Flow 'volume_create_manager' (77e1d81a-5624-4bc0-a174-c42f1ac22471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-38a45875-1ba5-4f0c-b040-7ddb4fe95f6e tempest-CreateVolumesFromImageTest-737433471 None] Created volume successfully. Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4c89ff-6781-4481-aa79-2f8fb465d306]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:30 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c Aug 28 16:36:30 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:30 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-8e0228b8-9783-4267-b1b7-30b5d7485737-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" returned: 0 in 0.602s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:30 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-8e0228b8-9783-4267-b1b7-30b5d7485737-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:30 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-quobyte-8e0228b8-9783-4267-b1b7-30b5d7485737" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-8e0228b8-9783-4267-b1b7-30b5d7485737" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ea0b4-adbd-4f4b-b6ae-fca705a90419]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:30 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 Aug 28 16:36:30 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:30 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-quobyte-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c" released by "delete_volume" :: held 1.054s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Created reservations ['02c2efea-c1ee-4f11-9c69-ccce42aa6bb0', '9928812d-cc6f-47ce-8585-5990695b20b1', '11853553-1ae3-4074-8354-a78a2d4d1279', '29744767-455f-481c-92ac-e9e2018aed3b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:31 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737" returned: 0 in 0.517s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:31 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:31 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:31 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737 Aug 28 16:36:31 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:31 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:31 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:31 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Deleted volume successfully. Aug 28 16:36:31 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-8e0228b8-9783-4267-b1b7-30b5d7485737" returned: 0 in 0.454s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f73c3dda-6031-4d7b-8613-ed422c8c08a9 tempest-CreateVolumesFromSnapshotTest-1603352687 None] Lock "cinder-3ee5f6c0-4ab0-4d45-88ab-3bd953f2f55c-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-8e0228b8-9783-4267-b1b7-30b5d7485737" released by "delete_volume" :: held 1.050s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Created reservations ['d38fc75d-edc7-42dd-b459-1b88da8282d8', '878a81f8-0878-49be-8f7f-bf920561105b', 'b131a945-bf48-460a-be64-b7b9f253fdee', '7e223efb-f5a0-4ccb-b4f2-a838c4c2a025'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:31 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.438s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:31 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:31 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:32 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.393s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Deleted volume successfully. Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5d846063-8d60-4ab4-a81e-9a3fce48c93f tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-8e0228b8-9783-4267-b1b7-30b5d7485737-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-950efd3c-5b5a-4a4f-b659-7f63e112dc57-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-950efd3c-5b5a-4a4f-b659-7f63e112dc57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-quobyte-950efd3c-5b5a-4a4f-b659-7f63e112dc57" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-950efd3c-5b5a-4a4f-b659-7f63e112dc57" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e5ce78-200f-4c67-8466-f67d3f326813]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:33 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 Aug 28 16:36:33 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:33 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57" returned: 0 in 0.489s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:33 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57 Aug 28 16:36:33 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:33 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950efd3c-5b5a-4a4f-b659-7f63e112dc57" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-950efd3c-5b5a-4a4f-b659-7f63e112dc57" released by "delete_volume" :: held 0.863s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:33 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Created reservations ['da01ebf4-bce2-4b3f-a478-781ca37f466a', '40fd01bf-6708-49bf-9aa9-9c92ace533a1', '00b0a6ed-9e21-45b7-8aa5-07a13121908a', 'f16507f3-a772-43a0-8943-29e2bcc6398e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:34 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:34 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-4c9ca21f-47f5-4391-b7ee-442d1542ae9c-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-4c9ca21f-47f5-4391-b7ee-442d1542ae9c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-quobyte-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e1f7b-e5ec-4f7b-932c-11758185f19d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:34 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:34 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Deleted volume successfully. Aug 28 16:36:34 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c Aug 28 16:36:34 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8f6ff7cb-a3ce-4965-a698-d4d7e27c50a1 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-950efd3c-5b5a-4a4f-b659-7f63e112dc57-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:34 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" returned: 0 in 0.519s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:34 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c Aug 28 16:36:34 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:35 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" returned: 0 in 0.327s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-4c9ca21f-47f5-4391-b7ee-442d1542ae9c" released by "delete_volume" :: held 0.907s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Created reservations ['55123a5c-5dec-4a06-9ee7-657ef13cff9b', 'ea88c99b-fca0-437f-a554-589c81301244', 'ed8d37bb-7117-4b08-91cb-816bd7b9e1c8', '87da0a7f-c2ea-4016-a4e2-72ad4a7f5371'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (401103b6-c6a1-4d91-9988-67d0bfe2e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa41d917-c8a4-443b-b6f7-f2dccc3c5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa41d917-c8a4-443b-b6f7-f2dccc3c5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039594796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7e922e-8215-4b6e-a828-92f6b3badaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:35Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a608ef9-2dba-4cb3-b677-f828bf0f7be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a608ef9-2dba-4cb3-b677-f828bf0f7be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f7c325-e99f-44db-a7e5-1538dbe18a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f7c325-e99f-44db-a7e5-1538dbe18a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7e922e-8215-4b6e-a828-92f6b3badaca', 'volume_name': 'volume-6f7e922e-8215-4b6e-a828-92f6b3badaca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abf9255-e232-41e3-9248-45d71661776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abf9255-e232-41e3-9248-45d71661776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7c68e5-2f70-45d0-834e-f98340aeccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:35 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Volume 6f7e922e-8215-4b6e-a828-92f6b3badaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7e922e-8215-4b6e-a828-92f6b3badaca', 'volume_size': 1} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039594796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7e922e-8215-4b6e-a828-92f6b3badaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:35Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Creating volume 6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:35 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:35 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca 1073741824 Aug 28 16:36:35 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:35 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:35 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:35 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.332s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Deleted volume successfully. Aug 28 16:36:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8079c518-97c1-4c5c-adf4-258f546b5cf2 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-4c9ca21f-47f5-4391-b7ee-442d1542ae9c-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca 1073741824" returned: 0 in 0.646s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:36 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca Aug 28 16:36:36 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:36 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca" returned: 0 in 0.363s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7c68e5-2f70-45d0-834e-f98340aeccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7e922e-8215-4b6e-a828-92f6b3badaca', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf3841e-388d-4e24-bc29-95a421df8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Volume volume-6f7e922e-8215-4b6e-a828-92f6b3badaca (6f7e922e-8215-4b6e-a828-92f6b3badaca): created successfully Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf3841e-388d-4e24-bc29-95a421df8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (401103b6-c6a1-4d91-9988-67d0bfe2e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-894a0475-4de0-4580-ae2c-fe82a17659cd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:36 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e77e935b-0504-4b0f-aaaa-c6461f928a76 tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-894a0475-4de0-4580-ae2c-fe82a17659cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-quobyte-894a0475-4de0-4580-ae2c-fe82a17659cd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-894a0475-4de0-4580-ae2c-fe82a17659cd" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Flow 'volume_create_manager' (ef9c444f-bd4a-4a40-b902-5689a6436989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ce2347-f89c-4aef-93ab-4d06306f4a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbaca80-eac3-4fd7-9d2b-9fa7a347ee0f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ce2347-f89c-4aef-93ab-4d06306f4a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-709464318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950800ca-3a74-4a2d-8ea5-4bf48be2e13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f905975c14e84899854dc8b07d2b4d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:37Z,use_quota=True,user_id='34753b3a8b36498ca371fb012ccfbe92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab192c7-ed41-45d2-8d6e-3669431922a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab192c7-ed41-45d2-8d6e-3669431922a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c52482-f556-4d27-8880-b055d4d02d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c52482-f556-4d27-8880-b055d4d02d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950800ca-3a74-4a2d-8ea5-4bf48be2e13e', 'volume_name': 'volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b5c946-af41-4454-9923-b78abc884a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b5c946-af41-4454-9923-b78abc884a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858e45ae-be51-4695-b68c-239c8e9d146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:36 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Volume 950800ca-3a74-4a2d-8ea5-4bf48be2e13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e', 'volume_size': 1} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-709464318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950800ca-3a74-4a2d-8ea5-4bf48be2e13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f905975c14e84899854dc8b07d2b4d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:37Z,use_quota=True,user_id='34753b3a8b36498ca371fb012ccfbe92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Creating volume 950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:36 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:36 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e 1073741824 Aug 28 16:36:36 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:36 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd Aug 28 16:36:36 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:37 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd" returned: 0 in 0.457s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:37 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd Aug 28 16:36:37 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:37 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e 1073741824" returned: 0 in 0.525s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:37 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:37 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:37 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-894a0475-4de0-4580-ae2c-fe82a17659cd" returned: 0 in 0.338s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-894a0475-4de0-4580-ae2c-fe82a17659cd" released by "delete_volume" :: held 0.880s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Created reservations ['68eb826d-d90c-4397-ba6d-62822935bc4b', '08227dca-9a10-426d-adbf-258a2c75249b', '75a719fb-80ef-4df4-ae81-91434293a088', '6af6ef20-4dd3-432f-83d9-ff773993f9ac'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:37 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858e45ae-be51-4695-b68c-239c8e9d146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfcf47a-64a9-400d-aa3e-a3482c96c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:37 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Volume volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e (950800ca-3a74-4a2d-8ea5-4bf48be2e13e): created successfully Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfcf47a-64a9-400d-aa3e-a3482c96c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Flow 'volume_create_manager' (ef9c444f-bd4a-4a40-b902-5689a6436989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-2892f124-2f1e-41d3-ba2d-5c76dc883607-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-299c871a-6567-4756-86c5-e431742e3788 tempest-VolumeDependencyTests-1057059045 None] Created volume successfully. Aug 28 16:36:37 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:37 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-2892f124-2f1e-41d3-ba2d-5c76dc883607-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "cinder-quobyte-2892f124-2f1e-41d3-ba2d-5c76dc883607" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-2892f124-2f1e-41d3-ba2d-5c76dc883607" acquired by "delete_volume" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 of volume 6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f249e8-181a-41d2-928e-758633de2b31]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca84a8-99af-41a4-8fce-5c2bd164b1bc]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:38 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 Aug 28 16:36:38 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:38 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Deleted volume successfully. Aug 28 16:36:38 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca Aug 28 16:36:38 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-706ee0d6-e3c0-4ad5-a46e-6960df660128 tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-894a0475-4de0-4580-ae2c-fe82a17659cd-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:38 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607" returned: 0 in 0.413s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:38 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607 Aug 28 16:36:38 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:38 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca" returned: 0 in 0.462s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:38 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 1G Aug 28 16:36:38 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:38 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2892f124-2f1e-41d3-ba2d-5c76dc883607" returned: 0 in 0.320s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-quobyte-2892f124-2f1e-41d3-ba2d-5c76dc883607" released by "delete_volume" :: held 0.795s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:38 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Created reservations ['4b72c05c-a0cb-4cba-a2e3-99567027c843', 'bab0663b-b37c-42b5-8034-cd8fa1236536', '1b84d0ab-4ed9-4a44-b6d8-b5f8362d5ae8', '0e90e6fb-ff38-4c7f-bb2a-1140887a22de'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:39 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:39 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:39 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 1G" returned: 0 in 0.650s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f7e922e-8215-4b6e-a828-92f6b3badaca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:39 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f7e922e-8215-4b6e-a828-92f6b3badaca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 Aug 28 16:36:39 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:39 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.345s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Deleted volume successfully. Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d98727e5-cb4e-4390-b9a1-7e19873a63ff tempest-CreateVolumesFromImageTest-737433471 None] Lock "cinder-2892f124-2f1e-41d3-ba2d-5c76dc883607-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:39 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f7e922e-8215-4b6e-a828-92f6b3badaca -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" returned: 0 in 0.389s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:39 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 is being set with open permissions: ugo+rw Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:39 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 Aug 28 16:36:39 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:39 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" returned: 0 in 0.298s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:39 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info Aug 28 16:36:39 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:40 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:40 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info is being set with open permissions: ugo+rw Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:40 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info Aug 28 16:36:40 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:40 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.info" returned: 0 in 0.300s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.534s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Creating offline snapshot 6135e298-c0a9-4fed-a1c8-9537ee1ca381 of volume 950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b7cf7-2b4a-47f1-8570-d2db7a9ec6f3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-18fe7b65-5a6f-4393-b7fd-33f0b16d631a tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:36:40 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:40 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:41 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.492s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:41 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 1G Aug 28 16:36:41 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 of volume 6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867ae55-8a72-4ae2-921f-303db932b1e6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:41 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 Aug 28 16:36:41 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:41 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 1G" returned: 0 in 0.647s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:41 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:41 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:41 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" returned: 0 in 0.508s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f7e922e-8215-4b6e-a828-92f6b3badaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee200e6c-aea2-4abb-ac9d-d90d73d9213b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:42 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca Aug 28 16:36:42 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:42 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.463s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:42 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 is being set with open permissions: ugo+rw Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:42 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:42 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:42 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca" returned: 0 in 0.546s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:42 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 Aug 28 16:36:42 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:42 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.402s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:42 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info Aug 28 16:36:42 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:43 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" returned: 0 in 0.557s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:43 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:43 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info is being set with open permissions: ugo+rw Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:43 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56 Aug 28 16:36:43 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:43 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info Aug 28 16:36:43 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:43 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca.132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:43 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56" released by "_delete_snapshot" :: held 2.154s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.info" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" released by "delete_snapshot" :: held 2.201s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4809d72c-53e7-4e97-a3a3-9c3b05bc11f8 tempest-VolumeDependencyTests-1057059045 None] Create snapshot completed successfully Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Created reservations ['dfa8cb58-11aa-4840-b522-0079049bd01f', '4c5713e8-bf53-452c-822a-23d002a7d291', '556c9f8d-d518-4ec5-94ea-368e10a7b800', '58d36156-a7b1-46d6-9797-5fe88b6800c4'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:43 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:36:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-7fad738e-cccd-41b2-8b16-3e96bff22aa9 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-132c4c8a-7c48-4d5a-bc02-4d7dd32bce56-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-6f7e922e-8215-4b6e-a828-92f6b3badaca-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-6f7e922e-8215-4b6e-a828-92f6b3badaca-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" acquired by "delete_volume" :: waited 0.026s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4588150-b3f2-4f21-9135-0ab842b8daad]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:44 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca Aug 28 16:36:44 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Flow 'volume_create_manager' (0892a262-e90d-49d3-9d80-4664e161063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311d39dd-9dd9-4993-a431-7319ea9ee2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (311d39dd-9dd9-4993-a431-7319ea9ee2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-316287808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b36688-ca9d-4c67-9320-92e4ad4ea285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f905975c14e84899854dc8b07d2b4d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6135e298-c0a9-4fed-a1c8-9537ee1ca381,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:45Z,use_quota=True,user_id='34753b3a8b36498ca371fb012ccfbe92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b450d84-d580-4045-93cd-afdfe36ffa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b450d84-d580-4045-93cd-afdfe36ffa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790528f-dbcf-4f35-9d91-7ca9588c5c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790528f-dbcf-4f35-9d91-7ca9588c5c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1b36688-ca9d-4c67-9320-92e4ad4ea285', 'volume_name': 'volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285', 'volume_size': 1, 'snapshot_id': '6135e298-c0a9-4fed-a1c8-9537ee1ca381'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dfa256-7bbc-4ddd-bda0-52a2578e7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dfa256-7bbc-4ddd-bda0-52a2578e7242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5945c524-146e-4ac9-959e-73f429ba5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:45 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Volume d1b36688-ca9d-4c67-9320-92e4ad4ea285: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285', 'volume_size': 1, 'snapshot_id': '6135e298-c0a9-4fed-a1c8-9537ee1ca381'} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381-d1b36688-ca9d-4c67-9320-92e4ad4ea285" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:45 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca" returned: 0 in 0.543s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381-d1b36688-ca9d-4c67-9320-92e4ad4ea285" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Creating volume d1b36688-ca9d-4c67-9320-92e4ad4ea285 from snapshot 6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:45 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca Aug 28 16:36:45 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] snapshot: 6135e298-c0a9-4fed-a1c8-9537ee1ca381, volume: d1b36688-ca9d-4c67-9320-92e4ad4ea285, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde18748-d142-44c4-8b55-09421b51b105]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:45 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:45 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:45 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-6f7e922e-8215-4b6e-a828-92f6b3badaca" returned: 0 in 0.414s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-6f7e922e-8215-4b6e-a828-92f6b3badaca" released by "delete_volume" :: held 1.074s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Created reservations ['f95116d4-a987-4c5e-bebf-55e39da070a7', '401a12cd-852d-41f3-898a-89fdaf17b323', '86d42b16-7a06-4086-a1b3-73bdcc4031e1', '2309a5be-71d8-4405-9b74-37f2b4f0d220'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:45 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.554s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:36:45 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:45 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9f0581-bf1a-4e41-b930-f31188c11225]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:46 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:46 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:46 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.445s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Flow 'volume_create_manager' (072f7dca-ff16-4857-8755-9c066b5db4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e90dbea-0118-4585-9224-7858e27a1a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e90dbea-0118-4585-9224-7858e27a1a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c36af9-6a03-4ce3-85b2-b7a28545fad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd2b6bd1d284df1886717e4ad1fa5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:46Z,use_quota=True,user_id='3e05eaed308a4400bd65d1f8210e3f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e189c83d-afb5-4c7a-87d0-70481eb342ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e189c83d-afb5-4c7a-87d0-70481eb342ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6a7d10-2560-45c4-8ee0-4500477c244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.image.glance [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Creating Keystone auth plugin from conf {{(pid=86193) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-66d9c29a-2f4a-4692-a53e-3686d66d685b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-6f7e922e-8215-4b6e-a828-92f6b3badaca-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:46 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.527s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:46 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 Aug 28 16:36:46 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6a7d10-2560-45c4-8ee0-4500477c244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0c36af9-6a03-4ce3-85b2-b7a28545fad7', 'volume_name': 'volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7', 'volume_size': 1, 'image_id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b244c9970f120dac5ede0f3aabd3897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2dd2b6bd1d284df1886717e4ad1fa5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '367e49ca2b0c558f30e03fad2a9b26c8d1446362080f6fce18bf84ccd3368904c6933fefc1fa0897bddf2a04a2e07138f72dceb624776bfd4802a7cec4e056fc', 'id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'created_at': datetime.datetime(2026, 8, 28, 14, 36, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93887b80-c203-4154-a6da-545a5dfa3a79/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c5a567-ef41-4d2d-8d68-5ba3d9d94fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c5a567-ef41-4d2d-8d68-5ba3d9d94fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d0c608-f423-43f4-8720-1f6110a7e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7', 'volume_size': 1, 'image_id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b244c9970f120dac5ede0f3aabd3897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2dd2b6bd1d284df1886717e4ad1fa5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '367e49ca2b0c558f30e03fad2a9b26c8d1446362080f6fce18bf84ccd3368904c6933fefc1fa0897bddf2a04a2e07138f72dceb624776bfd4802a7cec4e056fc', 'id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'created_at': datetime.datetime(2026, 8, 28, 14, 36, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93887b80-c203-4154-a6da-545a5dfa3a79/file', 'properties': {}}, 'image_service': } Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Trying to clone d0c36af9-6a03-4ce3-85b2-b7a28545fad7 from image 93887b80-c203-4154-a6da-545a5dfa3a79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}]). {{(pid=86193) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 16:36:46 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Image download 0.00 MB at 0.00 MB/s Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7f34c2-f793-4554-8918-22c1278b9fb5]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:47 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:47 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:47 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 0 in 0.962s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:48 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:48 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (fcbda3c2-f9b0-4368-9587-c98a7d06ed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e42246-be20-4802-a69c-4f19f470d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e42246-be20-4802-a69c-4f19f470d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600576037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de98c7cb-8322-4205-91f2-28c2444aedf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:48Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4afd39-63f8-4111-b801-0eaf9db613a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4afd39-63f8-4111-b801-0eaf9db613a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae21b672-c9ee-45d5-8c1b-06595a0c1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae21b672-c9ee-45d5-8c1b-06595a0c1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de98c7cb-8322-4205-91f2-28c2444aedf9', 'volume_name': 'volume-de98c7cb-8322-4205-91f2-28c2444aedf9', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38ef8a4-3e8c-4c4f-9ae8-015ed51718c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38ef8a4-3e8c-4c4f-9ae8-015ed51718c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59976a9b-bcb0-4dc9-a6fc-f0cb9b373f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:48 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Volume de98c7cb-8322-4205-91f2-28c2444aedf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de98c7cb-8322-4205-91f2-28c2444aedf9', 'volume_size': 1} Aug 28 16:36:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:49 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 1 in 1.125s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:49 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Temporary image 93887b80-c203-4154-a6da-545a5dfa3a79 is fetched for user 3e05eaed308a4400bd65d1f8210e3f0d. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 16:36:49 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9feeb7-8f7f-46cd-8a76-6d3eaa2a6bf0]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:49 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:49 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:50 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 0 in 1.011s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:50 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:50 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:51 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:52 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285" returned: 0 in 5.686s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:36:52 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Converted 1024.00 MB image at 180.01 MB/s Aug 28 16:36:52 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 is being set with open permissions: ugo+rw Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:52 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 Aug 28 16:36:52 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:52 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" released by "_copy_volume_from_snapshot" :: held 7.139s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381-d1b36688-ca9d-4c67-9320-92e4ad4ea285" released by "_create_volume_from_snapshot" :: held 7.230s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.260s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.580s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600576037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de98c7cb-8322-4205-91f2-28c2444aedf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:48Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Creating volume de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:52 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:52 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 1073741824 Aug 28 16:36:52 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5945c524-146e-4ac9-959e-73f429ba5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285', 'volume_size': 1, 'snapshot_id': '6135e298-c0a9-4fed-a1c8-9537ee1ca381'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e0ef41-4320-4714-9c25-bc36fad73862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:52 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Volume volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 (d1b36688-ca9d-4c67-9320-92e4ad4ea285): created successfully Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e0ef41-4320-4714-9c25-bc36fad73862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:52 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Flow 'volume_create_manager' (0892a262-e90d-49d3-9d80-4664e161063d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:52 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0cf532d8-6940-43b6-82a1-86327d58ae5b tempest-VolumeDependencyTests-1057059045 None] Created volume successfully. Aug 28 16:36:53 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 1073741824" returned: 0 in 0.544s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:53 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 Aug 28 16:36:53 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-6135e298-c0a9-4fed-a1c8-9537ee1ca381-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-6135e298-c0a9-4fed-a1c8-9537ee1ca381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Deleting offline snapshot 6135e298-c0a9-4fed-a1c8-9537ee1ca381 of volume 950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] snapshot_file for this snap is: volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[14108958-b453-4563-99c0-d6e2990c6041]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:53 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:53 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:53 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9" returned: 0 in 0.371s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c36af9-6a03-4ce3-85b2-b7a28545fad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd2b6bd1d284df1886717e4ad1fa5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:36:46Z,use_quota=True,user_id='3e05eaed308a4400bd65d1f8210e3f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Creating volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:36:53 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59976a9b-bcb0-4dc9-a6fc-f0cb9b373f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de98c7cb-8322-4205-91f2-28c2444aedf9', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:53 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1073741824 Aug 28 16:36:53 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a492c9-f9e5-41c9-959e-a0288e15a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:53 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Volume volume-de98c7cb-8322-4205-91f2-28c2444aedf9 (de98c7cb-8322-4205-91f2-28c2444aedf9): created successfully Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a492c9-f9e5-41c9-959e-a0288e15a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (fcbda3c2-f9b0-4368-9587-c98a7d06ed98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-91fa8770-e4a3-49fa-94a7-32cca814541c tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:36:53 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.592s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81b54f-b9f5-4948-84b0-722ce4f1ecf1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:54 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1073741824" returned: 0 in 0.578s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:54 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:54 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:54 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 Aug 28 16:36:54 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:54 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Attempting download of 93887b80-c203-4154-a6da-545a5dfa3a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}])) to volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e8796-7f3a-416c-9aca-aa7655072d8a]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:54 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.727s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:54 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:54 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:54 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8 Aug 28 16:36:54 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 78bb1feb-ac03-4767-8300-a0c762fa3865 of volume de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3fa590-ed9d-4c0a-8354-b404c70a4386]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:55 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8" returned: 0 in 0.523s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:55 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.529s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:55 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 Aug 28 16:36:55 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381 Aug 28 16:36:55 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8 Aug 28 16:36:55 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9" returned: 0 in 0.460s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:55 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8" returned: 1 in 0.443s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93887b80-c203-4154-a6da-545a5dfa3a79_dh_jefy8' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[030e434d-4a09-44cc-a8e7-2b2c529a1168]: (4, 'raw') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:55 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 1G Aug 28 16:36:55 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e.6135e298-c0a9-4fed-a1c8-9537ee1ca381" returned: 0 in 0.400s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=175,cinder:UPDATE=247,cinder:DELETE=23,cinder:INSERT=66 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-6135e298-c0a9-4fed-a1c8-9537ee1ca381" released by "_delete_snapshot" :: held 2.388s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" released by "delete_snapshot" :: held 2.430s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:UPDATE=229,cinder:SELECT=172,cinder:INSERT=55,cinder:DELETE=21 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:36:55 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:55 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Created reservations ['2dd30500-5086-49ce-a0d1-3c3cf9af9bf4', 'c9acb7f8-3d3f-4a7f-a78a-842fcd8476bb', '9fcbe784-a7d2-40dc-9623-05937cc46081', '8557d5a2-aa68-499e-b1e4-da45f1b5e9de'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:55 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Delete snapshot completed successfully. Aug 28 16:36:55 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2d71f638-e2fb-4557-9658-9c13e6172ce0 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-6135e298-c0a9-4fed-a1c8-9537ee1ca381-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:56 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 1G" returned: 0 in 0.536s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de98c7cb-8322-4205-91f2-28c2444aedf9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de98c7cb-8322-4205-91f2-28c2444aedf9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 Aug 28 16:36:56 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:56 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD Aug 28 16:36:56 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-950800ca-3a74-4a2d-8ea5-4bf48be2e13e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:56 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:56 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de98c7cb-8322-4205-91f2-28c2444aedf9 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865" returned: 0 in 0.439s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:56 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 is being set with open permissions: ugo+rw Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-950800ca-3a74-4a2d-8ea5-4bf48be2e13e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD" returned: 1 in 0.542s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] 93887b80-c203-4154-a6da-545a5dfa3a79 was raw, converting to qcow2 {{(pid=86193) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 Aug 28 16:36:56 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:56 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 Aug 28 16:36:56 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" acquired by "delete_volume" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff019f0-b8b9-4190-b5aa-a8f807b1e008]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865" returned: 0 in 0.336s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:56 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:56 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:56 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info Aug 28 16:36:56 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:57 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" returned: 0 in 0.653s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_93887b80-c203-4154-a6da-545a5dfa3a79_x6d2nfuwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:36:57 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:57 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info" returned: 0 in 0.323s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info is being set with open permissions: ugo+rw Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:57 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1G Aug 28 16:36:57 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:57 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info Aug 28 16:36:57 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:57 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.558s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:57 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e Aug 28 16:36:57 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:57 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.info" returned: 0 in 0.281s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e2adeb1b-de9e-41c7-a6bf-2dea52791b79 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:36:57 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" returned: 0 in 0.325s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 1G" returned: 0 in 0.412s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Downloaded image 93887b80-c203-4154-a6da-545a5dfa3a79 ((None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}])) to volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7 successfully. {{(pid=86193) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Temporary image 93887b80-c203-4154-a6da-545a5dfa3a79 for user 3e05eaed308a4400bd65d1f8210e3f0d is deleted. {{(pid=86193) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.volume_utils [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Marking volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7 as bootable. {{(pid=86193) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-950800ca-3a74-4a2d-8ea5-4bf48be2e13e" released by "delete_volume" :: held 0.991s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Copying metadata from image 93887b80-c203-4154-a6da-545a5dfa3a79 to d0c36af9-6a03-4ce3-85b2-b7a28545fad7. {{(pid=86193) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Creating volume glance metadata for volume d0c36af9-6a03-4ce3-85b2-b7a28545fad7 backed by image 93887b80-c203-4154-a6da-545a5dfa3a79 with: {'image_id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b244c9970f120dac5ede0f3aabd3897f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86193) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Created reservations ['3052e32e-22f5-4190-8b3d-558efd862e79', '354bd18a-a631-4b4d-97fb-a422474c2d02', 'a692de91-cf92-406e-8b2b-30f76206050e', '5308df44-08f9-4ddb-9659-321b417866f0'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d0c608-f423-43f4-8720-1f6110a7e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7', 'volume_size': 1, 'image_id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93887b80-c203-4154-a6da-545a5dfa3a79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b244c9970f120dac5ede0f3aabd3897f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2dd2b6bd1d284df1886717e4ad1fa5e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '367e49ca2b0c558f30e03fad2a9b26c8d1446362080f6fce18bf84ccd3368904c6933fefc1fa0897bddf2a04a2e07138f72dceb624776bfd4802a7cec4e056fc', 'id': '93887b80-c203-4154-a6da-545a5dfa3a79', 'created_at': datetime.datetime(2026, 8, 28, 14, 36, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 14, 36, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93887b80-c203-4154-a6da-545a5dfa3a79/file', 'properties': {}}, 'image_service': }' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab66a1d-7c71-4671-8887-ef6987d9e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:36:57 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Volume volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 (d0c36af9-6a03-4ce3-85b2-b7a28545fad7): created successfully Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab66a1d-7c71-4671-8887-ef6987d9e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Flow 'volume_create_manager' (072f7dca-ff16-4857-8755-9c066b5db4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:36:57 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-be062c9f-7e24-4081-9dd9-4cac95b5b145 tempest-VolumeImageDependencyTests-469855522 None] Created volume successfully. Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:36:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:57 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:36:57 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:58 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.259s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:36:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Deleted volume successfully. Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-25349251-bfbe-4e96-ba2e-3b709bff0383 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-950800ca-3a74-4a2d-8ea5-4bf48be2e13e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-78bb1feb-ac03-4767-8300-a0c762fa3865-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-78bb1feb-ac03-4767-8300-a0c762fa3865-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-78bb1feb-ac03-4767-8300-a0c762fa3865" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-78bb1feb-ac03-4767-8300-a0c762fa3865" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 78bb1feb-ac03-4767-8300-a0c762fa3865 of volume de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf6012-5b23-49c0-82c0-b4ba28922ad8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:58 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 Aug 28 16:36:58 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:58 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865" returned: 0 in 0.458s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de98c7cb-8322-4205-91f2-28c2444aedf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54fc91-e78b-45c0-8b57-9fd7c2950c83]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-d1b36688-ca9d-4c67-9320-92e4ad4ea285-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-d1b36688-ca9d-4c67-9320-92e4ad4ea285-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Acquiring lock "cinder-d0c36af9-6a03-4ce3-85b2-b7a28545fad7-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "cinder-d0c36af9-6a03-4ce3-85b2-b7a28545fad7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:59 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 Aug 28 16:36:59 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" acquired by "delete_volume" :: waited 0.035s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3222cd6-d562-40d8-9298-b8df5d4fe8b3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Acquiring lock "cinder-quobyte-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "cinder-quobyte-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[193cb034-eab7-47f3-bbf2-bb97a59b390e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 Aug 28 16:36:59 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 Aug 28 16:36:59 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9" returned: 0 in 0.545s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 Aug 28 16:36:59 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285" returned: 0 in 0.535s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285 Aug 28 16:36:59 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" returned: 0 in 0.519s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7 Aug 28 16:36:59 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865" returned: 0 in 0.459s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:36:59 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865 Aug 28 16:36:59 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:36:59 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d1b36688-ca9d-4c67-9320-92e4ad4ea285" returned: 0 in 0.286s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:36:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-quobyte-d1b36688-ca9d-4c67-9320-92e4ad4ea285" released by "delete_volume" :: held 0.890s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Created reservations ['0dd64dfe-562f-4c9c-8102-801a2d334e39', 'b70c559c-0c79-44f9-8ac0-9ea7705f700c', '551ced04-fe5a-4f49-9925-65d8a8427275', '7c7c0a03-56ec-4c8c-aa18-d55cffe9bb25'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" returned: 0 in 0.318s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "cinder-quobyte-d0c36af9-6a03-4ce3-85b2-b7a28545fad7" released by "delete_volume" :: held 0.895s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:00 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Created reservations ['227f3e28-282b-4220-81d2-704d3662374c', '72d4ce2e-57b7-41b4-9760-91bc20c5173f', 'dcb136b6-fe6d-4e53-8537-adb67e31ada4', 'a8d25196-3806-4991-b407-2c4ee9a9c226'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:00 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:00 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9.78bb1feb-ac03-4767-8300-a0c762fa3865" returned: 0 in 0.393s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-78bb1feb-ac03-4767-8300-a0c762fa3865" released by "_delete_snapshot" :: held 2.032s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" released by "delete_snapshot" :: held 2.077s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:00 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:00 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Created reservations ['e385f458-b5d7-4488-a607-ecc7da81dcc3', '479af37f-b5b2-4ecd-a56b-41b5464b599a', '851fc78c-f973-4af8-9ad4-996a674b8d27', 'de11e8bf-028d-4470-bb6b-506ffeaf4e91'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:00 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.441s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Deleted volume successfully. Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b2dc74fa-cd31-4c28-9281-e44a46b7576d tempest-ProjectMemberTests-1795725571 None] Lock "cinder-78bb1feb-ac03-4767-8300-a0c762fa3865-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0b36efc7-0aea-4be4-a6f2-8edf35177b77 tempest-VolumeDependencyTests-1057059045 None] Lock "cinder-d1b36688-ca9d-4c67-9320-92e4ad4ea285-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:00 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Deleted volume successfully. Aug 28 16:37:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-df4ea417-2533-43b0-8438-35798c5e88ee tempest-VolumeImageDependencyTests-469855522 None] Lock "cinder-d0c36af9-6a03-4ce3-85b2-b7a28545fad7-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-de98c7cb-8322-4205-91f2-28c2444aedf9-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-de98c7cb-8322-4205-91f2-28c2444aedf9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f110a17-4231-49c8-9151-3f5795973eea]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:01 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 Aug 28 16:37:01 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:02 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9" returned: 0 in 0.518s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:02 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9 Aug 28 16:37:02 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:02 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-de98c7cb-8322-4205-91f2-28c2444aedf9" returned: 0 in 0.325s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-de98c7cb-8322-4205-91f2-28c2444aedf9" released by "delete_volume" :: held 0.946s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Created reservations ['fcb8ead2-bf86-433d-8f0b-4e3ec2bbd874', '5d4f38c8-8b1c-4d72-81d9-0c9bb0623798', '942e4a1e-2fbd-468e-b956-1484f84c096b', 'f02b41d7-19e3-4844-a698-3d40adc61216'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:03 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:03 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:03 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.439s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:03 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:03 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:03 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-49a12de7-a780-49fa-9fea-927f532fce08 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-de98c7cb-8322-4205-91f2-28c2444aedf9-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (c0c7b611-a500-4819-8066-4ec3d21097c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0603a5bb-36eb-4441-9b87-4d0433fa32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0603a5bb-36eb-4441-9b87-4d0433fa32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722955119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d324456-5132-4d30-9416-b888098cc298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:05Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96259649-f529-4a69-a20d-d5911d512036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96259649-f529-4a69-a20d-d5911d512036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87953c05-50e4-4e9f-95bf-e4ee4f729770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87953c05-50e4-4e9f-95bf-e4ee4f729770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d324456-5132-4d30-9416-b888098cc298', 'volume_name': 'volume-9d324456-5132-4d30-9416-b888098cc298', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e41254c-685c-41e4-b7e1-7a4939b70939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e41254c-685c-41e4-b7e1-7a4939b70939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b6584-5a6e-4b2f-aa6d-06d9034a6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Volume 9d324456-5132-4d30-9416-b888098cc298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d324456-5132-4d30-9416-b888098cc298', 'volume_size': 1} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1722955119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d324456-5132-4d30-9416-b888098cc298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:05Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Creating volume 9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:05 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 1073741824 Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:05 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Flow 'volume_create_manager' (3b35ab17-5df7-4cd7-90cf-ded06f665eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05065298-f850-4460-95a1-d17cadd6ee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05065298-f850-4460-95a1-d17cadd6ee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834c6bab-8a7f-41ca-8419-4afb64c913ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73cf9a2c00014081b727fc3563e50211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:05Z,use_quota=True,user_id='3cc1a113bb2f4af2b4b0d1e2b1ef87c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49caadc5-1eaa-49b0-a3cb-e8f7e4e3c91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49caadc5-1eaa-49b0-a3cb-e8f7e4e3c91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c39dd2e-79cb-4084-b7c9-fbb9892d2734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c39dd2e-79cb-4084-b7c9-fbb9892d2734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834c6bab-8a7f-41ca-8419-4afb64c913ac', 'volume_name': 'volume-834c6bab-8a7f-41ca-8419-4afb64c913ac', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6b15e1-a017-4260-892f-acf2b36784be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6b15e1-a017-4260-892f-acf2b36784be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c389e441-b5e4-4f8d-a11f-99ab530cc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Volume 834c6bab-8a7f-41ca-8419-4afb64c913ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834c6bab-8a7f-41ca-8419-4afb64c913ac', 'volume_size': 1} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:05 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 1073741824" returned: 0 in 0.553s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:05 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 Aug 28 16:37:05 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:05 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298" returned: 0 in 0.275s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834c6bab-8a7f-41ca-8419-4afb64c913ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73cf9a2c00014081b727fc3563e50211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:05Z,use_quota=True,user_id='3cc1a113bb2f4af2b4b0d1e2b1ef87c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Creating volume 834c6bab-8a7f-41ca-8419-4afb64c913ac {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:06 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3b6584-5a6e-4b2f-aa6d-06d9034a6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d324456-5132-4d30-9416-b888098cc298', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730a76ff-9066-4fdc-ac85-eee2ebb53d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:06 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac 1073741824 Aug 28 16:37:06 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Volume volume-9d324456-5132-4d30-9416-b888098cc298 (9d324456-5132-4d30-9416-b888098cc298): created successfully Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730a76ff-9066-4fdc-ac85-eee2ebb53d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (c0c7b611-a500-4819-8066-4ec3d21097c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bea14086-9a8c-40fb-a755-79606c9eb332 tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:06 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac 1073741824" returned: 0 in 0.465s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:06 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac Aug 28 16:37:06 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:06 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c389e441-b5e4-4f8d-a11f-99ab530cc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834c6bab-8a7f-41ca-8419-4afb64c913ac', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0784a6a-51c4-4166-9be1-e7628a3aff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Volume volume-834c6bab-8a7f-41ca-8419-4afb64c913ac (834c6bab-8a7f-41ca-8419-4afb64c913ac): created successfully Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0784a6a-51c4-4166-9be1-e7628a3aff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Flow 'volume_create_manager' (3b35ab17-5df7-4cd7-90cf-ded06f665eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-17bdd13f-4576-4c07-94ed-64b083d004d3 tempest-CinderUnicodeTest-1789306238 None] Created volume successfully. Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 049021dd-2ba9-40bf-9d28-cf00dd3f4f54 of volume 9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb844033-53f6-4bb8-a847-74d11a5ab4f0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:07 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 Aug 28 16:37:07 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:07 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298" returned: 0 in 0.386s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:07 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 1G Aug 28 16:37:07 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:07 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 1G" returned: 0 in 0.480s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d324456-5132-4d30-9416-b888098cc298 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:07 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d324456-5132-4d30-9416-b888098cc298 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 Aug 28 16:37:07 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:08 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d324456-5132-4d30-9416-b888098cc298 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54" returned: 0 in 0.364s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:08 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 is being set with open permissions: ugo+rw Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:08 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 Aug 28 16:37:08 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:08 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:08 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info Aug 28 16:37:08 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Flow 'volume_create_manager' (afa46461-f583-43a6-b801-7460e1b196c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8020f96a-6513-4667-82e3-28cdfc701e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8020f96a-6513-4667-82e3-28cdfc701e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-31093618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d7ebc8-2339-42bd-a58a-7720351b3199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73cf9a2c00014081b727fc3563e50211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:09Z,use_quota=True,user_id='3cc1a113bb2f4af2b4b0d1e2b1ef87c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2f7e01-cb7c-494d-a76c-8aa0b9fb3eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2f7e01-cb7c-494d-a76c-8aa0b9fb3eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47803b0-a982-4b77-b900-2619cf6036ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47803b0-a982-4b77-b900-2619cf6036ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d7ebc8-2339-42bd-a58a-7720351b3199', 'volume_name': 'volume-96d7ebc8-2339-42bd-a58a-7720351b3199', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d78066-8276-4a55-b228-194f7e1bc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d78066-8276-4a55-b228-194f7e1bc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534fed83-30d8-4254-b7e3-6bdf5b54e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Volume 96d7ebc8-2339-42bd-a58a-7720351b3199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d7ebc8-2339-42bd-a58a-7720351b3199', 'volume_size': 1} Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:08 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:08 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info is being set with open permissions: ugo+rw Aug 28 16:37:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:08 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info Aug 28 16:37:08 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:09 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.info" returned: 0 in 0.291s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-31093618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d7ebc8-2339-42bd-a58a-7720351b3199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73cf9a2c00014081b727fc3563e50211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:09Z,use_quota=True,user_id='3cc1a113bb2f4af2b4b0d1e2b1ef87c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Creating volume 96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:09 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:09 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 1073741824 Aug 28 16:37:09 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:09 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-dd364d90-ad50-4d34-840b-789c3b718ca5 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:09 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 1073741824" returned: 0 in 0.483s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:09 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 Aug 28 16:37:09 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:10 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199" returned: 0 in 0.270s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534fed83-30d8-4254-b7e3-6bdf5b54e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d7ebc8-2339-42bd-a58a-7720351b3199', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8632764-49c3-4ed8-8e5a-87553bb194cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:10 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Volume volume-96d7ebc8-2339-42bd-a58a-7720351b3199 (96d7ebc8-2339-42bd-a58a-7720351b3199): created successfully Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8632764-49c3-4ed8-8e5a-87553bb194cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Flow 'volume_create_manager' (afa46461-f583-43a6-b801-7460e1b196c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-265ce513-25fc-4098-a06f-86f7366b0fee tempest-CinderUnicodeTest-1789306238 None] Created volume successfully. Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-049021dd-2ba9-40bf-9d28-cf00dd3f4f54-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-049021dd-2ba9-40bf-9d28-cf00dd3f4f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-049021dd-2ba9-40bf-9d28-cf00dd3f4f54" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-049021dd-2ba9-40bf-9d28-cf00dd3f4f54" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 049021dd-2ba9-40bf-9d28-cf00dd3f4f54 of volume 9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099d3a6-7055-4960-9056-c23f16f30336]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:10 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 Aug 28 16:37:10 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:10 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54" returned: 0 in 0.426s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d324456-5132-4d30-9416-b888098cc298(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39ae167-4aad-4519-92d8-c460463e1c6c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:10 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 Aug 28 16:37:10 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Creating offline snapshot a5f5af59-5f6d-4ce3-b310-e030aa965f58 of volume 96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b170b6-f3aa-4f93-aa6a-44cd886b3247]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:11 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298" returned: 0 in 0.502s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:11 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 Aug 28 16:37:11 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:11 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 Aug 28 16:37:11 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:11 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:11 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199" returned: 0 in 0.467s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54" returned: 0 in 0.437s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:11 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 1G Aug 28 16:37:11 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:11 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54 Aug 28 16:37:11 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:11 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298.049021dd-2ba9-40bf-9d28-cf00dd3f4f54" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-049021dd-2ba9-40bf-9d28-cf00dd3f4f54" released by "_delete_snapshot" :: held 1.741s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" released by "delete_snapshot" :: held 1.772s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Created reservations ['f4580a78-33a4-4a25-a557-d455bc980880', '634d06f1-9c86-4d17-bae4-300029bc1d85', '17fe3256-3769-433c-ae96-9191ea9d719a', '3210ae04-226f-41d8-8142-48f1f1536044'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:12 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:12 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-22c64a0b-3546-498f-8d82-d9c373096bee tempest-ProjectMemberTests-1795725571 None] Lock "cinder-049021dd-2ba9-40bf-9d28-cf00dd3f4f54-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 1G" returned: 0 in 0.472s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7ebc8-2339-42bd-a58a-7720351b3199 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:12 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7ebc8-2339-42bd-a58a-7720351b3199 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 Aug 28 16:37:12 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-9d324456-5132-4d30-9416-b888098cc298-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-9d324456-5132-4d30-9416-b888098cc298-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:12 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7eb68d-0939-4954-a628-61b4f7e0550a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7ebc8-2339-42bd-a58a-7720351b3199 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58" returned: 0 in 0.392s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:12 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 is being set with open permissions: ugo+rw Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:12 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 Aug 28 16:37:12 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Flow 'volume_create_manager' (d6c9bde2-8f3d-4b4a-a1e2-73c925b85d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9caf1a4-32f0-4320-84e3-64f67ad60061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9caf1a4-32f0-4320-84e3-64f67ad60061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-447138393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b288c65f-e756-483a-b0d6-f2a8500d3b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8598679f70aa4b00af7fe60c506bd1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:13Z,use_quota=True,user_id='465838f8e9f547d9a9543dfe939c4fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f24208-9da5-44af-8eda-c685a1f12885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f24208-9da5-44af-8eda-c685a1f12885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:12 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 Aug 28 16:37:12 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dedfae-1b28-4c5e-9d07-a66fb5a680cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5dedfae-1b28-4c5e-9d07-a66fb5a680cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b288c65f-e756-483a-b0d6-f2a8500d3b7b', 'volume_name': 'volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd434678-43b6-4750-a2e9-fb7200be261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd434678-43b6-4750-a2e9-fb7200be261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9076041-b38a-452d-ba46-3452b89593de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:12 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Volume b288c65f-e756-483a-b0d6-f2a8500d3b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b', 'volume_size': 1} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:12 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:12 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info Aug 28 16:37:12 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:12 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298" returned: 0 in 0.375s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:13 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298 Aug 28 16:37:13 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:13 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info" returned: 0 in 0.261s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:13 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info is being set with open permissions: ugo+rw Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:13 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info Aug 28 16:37:13 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:13 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9d324456-5132-4d30-9416-b888098cc298" returned: 0 in 0.269s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9d324456-5132-4d30-9416-b888098cc298" released by "delete_volume" :: held 0.719s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Created reservations ['bd6413b7-2e5e-4112-9c69-c8cac31e0ead', 'b7ec6b86-b5a8-41b8-b470-3ead4903d4cb', 'e01e3bdf-b6b9-40b8-a06d-a70ea7644098', 'fe1ac54d-046c-444a-a6c4-caceb2d38b66'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:13 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.info" returned: 0 in 0.249s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:13 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:13 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-447138393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b288c65f-e756-483a-b0d6-f2a8500d3b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8598679f70aa4b00af7fe60c506bd1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:13Z,use_quota=True,user_id='465838f8e9f547d9a9543dfe939c4fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Creating volume b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:13 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:13 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b 1073741824 Aug 28 16:37:13 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d205bf04-74db-4575-bbee-5f996fe08608 tempest-CinderUnicodeTest-1789306238 None] Create snapshot completed successfully Aug 28 16:37:13 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.277s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0ad9019d-0377-4dca-bbd6-c87f18bea83b tempest-ProjectMemberTests-1795725571 None] Lock "cinder-9d324456-5132-4d30-9416-b888098cc298-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:13 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b 1073741824" returned: 0 in 0.505s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:14 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:14 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (3a90d1fe-0f04-4793-8247-b81e6e8643c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd9eba-2e73-4946-95f6-169db4a098cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd9eba-2e73-4946-95f6-169db4a098cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781286563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d5b789-726b-4a61-b211-f3ea0e456485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:14Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e124fcc-6cc3-48a1-9345-40d307e84c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e124fcc-6cc3-48a1-9345-40d307e84c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68e310b-33ba-446e-8102-574299db9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68e310b-33ba-446e-8102-574299db9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d5b789-726b-4a61-b211-f3ea0e456485', 'volume_name': 'volume-79d5b789-726b-4a61-b211-f3ea0e456485', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dadab11-d38b-484f-ab0b-a6a5f77faa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dadab11-d38b-484f-ab0b-a6a5f77faa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df49870-22bd-4dad-a98d-8084318a5dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Volume 79d5b789-726b-4a61-b211-f3ea0e456485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d5b789-726b-4a61-b211-f3ea0e456485', 'volume_size': 1} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:14 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.252s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781286563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d5b789-726b-4a61-b211-f3ea0e456485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:14Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Creating volume 79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:14 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9076041-b38a-452d-ba46-3452b89593de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 1073741824 Aug 28 16:37:14 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a2dd56-77d8-473f-ae60-cfc9bbbef033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Volume volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b (b288c65f-e756-483a-b0d6-f2a8500d3b7b): created successfully Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a2dd56-77d8-473f-ae60-cfc9bbbef033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Flow 'volume_create_manager' (d6c9bde2-8f3d-4b4a-a1e2-73c925b85d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-79365e22-5eed-4bc0-9def-d3b34bbd8212 tempest-SnapshotDependencyTests-1192410893 None] Created volume successfully. Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-a5f5af59-5f6d-4ce3-b310-e030aa965f58-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-a5f5af59-5f6d-4ce3-b310-e030aa965f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-quobyte-a5f5af59-5f6d-4ce3-b310-e030aa965f58" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-a5f5af59-5f6d-4ce3-b310-e030aa965f58" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Deleting offline snapshot a5f5af59-5f6d-4ce3-b310-e030aa965f58 of volume 96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] snapshot_file for this snap is: volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23df718-a710-461c-8dc5-b20ac3f9eef6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:14 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 Aug 28 16:37:14 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:14 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 1073741824" returned: 0 in 0.505s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:14 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 Aug 28 16:37:14 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:14 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58" returned: 0 in 0.476s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d7ebc8-2339-42bd-a58a-7720351b3199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ffee6-b981-4e38-93ab-9002c7c89f7f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:15 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485" returned: 0 in 0.324s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:15 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 Aug 28 16:37:15 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.146s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df49870-22bd-4dad-a98d-8084318a5dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d5b789-726b-4a61-b211-f3ea0e456485', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fc9c1-fdb5-485d-88ac-27016aaa3346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Creating offline snapshot a6e665a9-19d5-4924-aed6-2c120c85677c of volume b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:15 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Volume volume-79d5b789-726b-4a61-b211-f3ea0e456485 (79d5b789-726b-4a61-b211-f3ea0e456485): created successfully Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fc9c1-fdb5-485d-88ac-27016aaa3346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (3a90d1fe-0f04-4793-8247-b81e6e8643c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[547945fc-cd95-4554-9fb2-f65c24594a8f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e42466a7-c907-48b0-ac8b-58d57ea4eb1f tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:15 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:15 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:15 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199" returned: 0 in 0.418s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:15 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 Aug 28 16:37:15 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:15 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.393s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:15 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c 1G Aug 28 16:37:15 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:15 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58" returned: 0 in 0.340s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:15 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58 Aug 28 16:37:15 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:16 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:16 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199.a5f5af59-5f6d-4ce3-b310-e030aa965f58" returned: 0 in 0.297s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c 1G" returned: 0 in 0.457s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:16 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:16 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-a5f5af59-5f6d-4ce3-b310-e030aa965f58" released by "_delete_snapshot" :: held 1.684s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" released by "delete_snapshot" :: held 1.711s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Created reservations ['5d0b05a2-ebb6-41c6-a08c-d041f8360a30', 'e73d1352-ad77-4082-8909-18185bc56992', 'cdfca637-8c95-4d43-a2e0-1f5362ce3f2b', '29772987-f56f-4ff6-9805-265aeff311fc'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Delete snapshot completed successfully. Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c40fc5ac-87c3-4ed2-8947-9691cf21c028 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-a5f5af59-5f6d-4ce3-b310-e030aa965f58-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:16 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.342s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:16 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c is being set with open permissions: ugo+rw Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:16 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:16 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-96d7ebc8-2339-42bd-a58a-7720351b3199-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-96d7ebc8-2339-42bd-a58a-7720351b3199-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db90bd-09be-40a0-8318-2ba8397db107]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:16 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.283s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:16 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info Aug 28 16:37:16 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:16 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 Aug 28 16:37:16 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info is being set with open permissions: ugo+rw Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:17 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info Aug 28 16:37:17 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:17 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:17 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199 Aug 28 16:37:17 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:17 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.info" returned: 0 in 0.275s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.892s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 9c2adc81-bcef-4507-9235-d31a278c2acf of volume 79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6120c-583c-4341-90f4-5200c1c96ad5]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6c9c0c84-79ed-429a-8061-4899ecf60ae1 tempest-SnapshotDependencyTests-1192410893 None] Create snapshot completed successfully Aug 28 16:37:17 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-96d7ebc8-2339-42bd-a58a-7720351b3199" returned: 0 in 0.264s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-96d7ebc8-2339-42bd-a58a-7720351b3199" released by "delete_volume" :: held 0.728s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Created reservations ['5208554c-1af2-40ed-8ffc-8b1cf38f602c', 'b33cb8e7-1dc7-4178-9ef8-62398e317a42', '78f7b99f-d06d-4a50-8096-ed3aab3724bb', '9bf5a9d2-336c-4476-ada2-48f1a9dbdb50'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:17 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 Aug 28 16:37:17 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:17 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:17 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:17 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485" returned: 0 in 0.446s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-834c6bab-8a7f-41ca-8419-4afb64c913ac-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:17 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf 1G Aug 28 16:37:17 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:17 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.316s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-834c6bab-8a7f-41ca-8419-4afb64c913ac-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Deleted volume successfully. Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-96759d17-5d7a-4786-89c8-ca02e41c6fd8 tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-96d7ebc8-2339-42bd-a58a-7720351b3199-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "cinder-quobyte-834c6bab-8a7f-41ca-8419-4afb64c913ac" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-834c6bab-8a7f-41ca-8419-4afb64c913ac" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf6cbbd-8e62-4d6a-ae53-0a2d0415e7ef]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:18 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac Aug 28 16:37:18 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:18 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf 1G" returned: 0 in 0.496s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d5b789-726b-4a61-b211-f3ea0e456485 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:18 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d5b789-726b-4a61-b211-f3ea0e456485 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf Aug 28 16:37:18 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:18 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:18 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac Aug 28 16:37:18 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:18 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d5b789-726b-4a61-b211-f3ea0e456485 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:18 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf is being set with open permissions: ugo+rw Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:18 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf Aug 28 16:37:18 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:18 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-834c6bab-8a7f-41ca-8419-4afb64c913ac" returned: 0 in 0.324s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-quobyte-834c6bab-8a7f-41ca-8419-4afb64c913ac" released by "delete_volume" :: held 0.814s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Created reservations ['b11cfdb0-66fe-43db-a009-feab5f36ffd8', '6712513b-189c-4c35-8250-c2b262a78820', '2ca0c033-1eca-47f4-adcd-1e89cb9b874b', '83f49c72-0fdd-4618-a9b3-fa98500aace9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Flow 'volume_create_manager' (caf3274e-0bdf-4506-b4fb-76e43ccc4caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5f1501-fcce-43a6-b55a-ead357808d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5f1501-fcce-43a6-b55a-ead357808d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b9dc53-4d86-4649-821b-5b02d6a83ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8598679f70aa4b00af7fe60c506bd1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6e665a9-19d5-4924-aed6-2c120c85677c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:19Z,use_quota=True,user_id='465838f8e9f547d9a9543dfe939c4fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d63030-814b-4544-9904-8bf7673e9ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d63030-814b-4544-9904-8bf7673e9ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc111dbb-b997-4729-85e7-d00781282405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc111dbb-b997-4729-85e7-d00781282405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25b9dc53-4d86-4649-821b-5b02d6a83ddd', 'volume_name': 'volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd', 'volume_size': 1, 'snapshot_id': 'a6e665a9-19d5-4924-aed6-2c120c85677c'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e9c32-daa6-4f4f-b3d1-e337c21a5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661e9c32-daa6-4f4f-b3d1-e337c21a5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37684d11-e005-43d2-a631-6501c8dac760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:18 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Volume 25b9dc53-4d86-4649-821b-5b02d6a83ddd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd', 'volume_size': 1, 'snapshot_id': 'a6e665a9-19d5-4924-aed6-2c120c85677c'} Aug 28 16:37:18 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf" returned: 0 in 0.301s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:19 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info Aug 28 16:37:19 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:19 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:19 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:19 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:19 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:19 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info is being set with open permissions: ugo+rw Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Deleted volume successfully. Aug 28 16:37:19 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info Aug 28 16:37:19 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-27f62782-df1c-44a5-b3dc-fd4f8d4f3a3e tempest-CinderUnicodeTest-1789306238 None] Lock "cinder-834c6bab-8a7f-41ca-8419-4afb64c913ac-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:19 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.info" returned: 0 in 0.285s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.628s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c-25b9dc53-4d86-4649-821b-5b02d6a83ddd" by "_create_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c-25b9dc53-4d86-4649-821b-5b02d6a83ddd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Creating volume 25b9dc53-4d86-4649-821b-5b02d6a83ddd from snapshot a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" by "_copy_volume_from_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6b828646-e5e3-46a9-a839-dad065e6b082 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] snapshot: a6e665a9-19d5-4924-aed6-2c120c85677c, volume: 25b9dc53-4d86-4649-821b-5b02d6a83ddd, {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ae2103-3962-4438-8c80-25470e254970]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:19 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:19 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:20 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.381s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc18ad2-3f3e-4dea-aa8b-47926c095db1]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:20 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:20 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:20 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.426s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Creating direct copy from snapshot {{(pid=86193) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.utils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Path /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd not found in is_blk_device check {{(pid=86193) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:20 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd Aug 28 16:37:20 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-9c2adc81-bcef-4507-9235-d31a278c2acf-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-9c2adc81-bcef-4507-9235-d31a278c2acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-9c2adc81-bcef-4507-9235-d31a278c2acf" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9c2adc81-bcef-4507-9235-d31a278c2acf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 9c2adc81-bcef-4507-9235-d31a278c2acf of volume 79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade01a8-5853-49ab-bf97-8c929f4eaff9]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:20 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf Aug 28 16:37:20 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:21 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf" returned: 0 in 0.572s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d5b789-726b-4a61-b211-f3ea0e456485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2bb84-042e-40ae-9767-3946ceed635f]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:21 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 Aug 28 16:37:21 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:22 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485" returned: 0 in 0.856s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:22 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf Aug 28 16:37:22 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:23 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf" returned: 0 in 0.880s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:23 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf Aug 28 16:37:23 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:23 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485.9c2adc81-bcef-4507-9235-d31a278c2acf" returned: 0 in 0.659s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-9c2adc81-bcef-4507-9235-d31a278c2acf" released by "_delete_snapshot" :: held 3.188s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" released by "delete_snapshot" :: held 3.223s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:24 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Created reservations ['02f9aa21-a3e6-4734-b3f1-501b717625da', 'd4bfa2e0-76b7-4396-a185-1f3241c373ac', '880cddc7-6d81-4ef5-9327-6bfddc8421e0', '071def37-22c9-418c-9295-7ec96e59807b'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-112d5e72-aefb-4f3a-9194-6bd033993f00 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-9c2adc81-bcef-4507-9235-d31a278c2acf-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:24 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-7a505456-01f9-4672-87a3-11466a940179 tempest-ProjectAdminTests-1274106830 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5247650146484, 'free_capacity_gb': 1774.5247650146484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86193) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-79d5b789-726b-4a61-b211-f3ea0e456485-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-79d5b789-726b-4a61-b211-f3ea0e456485-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" acquired by "delete_volume" :: waited 0.048s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49630f2-6cf6-46a8-99e3-0eb460cde1c8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:25 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 Aug 28 16:37:25 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:26 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485" returned: 0 in 0.744s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:26 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd" returned: 0 in 5.645s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.image.image_utils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Image conversion details: src /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd {{(pid=86193) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 16:37:26 devstack cinder-volume[86193]: INFO cinder.image.image_utils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Converted 1024.00 MB image at 181.30 MB/s Aug 28 16:37:26 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd is being set with open permissions: ugo+rw Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:26 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485 Aug 28 16:37:26 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:26 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd Aug 28 16:37:26 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:26 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-79d5b789-726b-4a61-b211-f3ea0e456485" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-79d5b789-726b-4a61-b211-f3ea0e456485" released by "delete_volume" :: held 1.203s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:26 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd" returned: 0 in 0.321s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" released by "_copy_volume_from_snapshot" :: held 6.912s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Created reservations ['5e0f5927-eb32-4bff-bd55-4d9f9dcd1899', '7740d6c8-b9ed-4d38-b82c-26977cfdfef6', 'b3dca85e-49b6-4578-a9de-ff7398baa78d', '42b16104-146b-4d76-8a06-7a7130199d4d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c-25b9dc53-4d86-4649-821b-5b02d6a83ddd" released by "_create_volume_from_snapshot" :: held 7.004s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.038s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37684d11-e005-43d2-a631-6501c8dac760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd', 'volume_size': 1, 'snapshot_id': 'a6e665a9-19d5-4924-aed6-2c120c85677c'}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1342056f-094d-4061-8c51-2e638dc5e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Volume volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd (25b9dc53-4d86-4649-821b-5b02d6a83ddd): created successfully Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1342056f-094d-4061-8c51-2e638dc5e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Flow 'volume_create_manager' (caf3274e-0bdf-4506-b4fb-76e43ccc4caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2325caba-a587-4dcd-ae87-c82a82a98ba6 tempest-SnapshotDependencyTests-1192410893 None] Created volume successfully. Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:26 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:26 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:27 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:27 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2760c938-8bad-4674-87f0-b8c898c958b5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-79d5b789-726b-4a61-b211-f3ea0e456485-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-a6e665a9-19d5-4924-aed6-2c120c85677c-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-a6e665a9-19d5-4924-aed6-2c120c85677c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Deleting offline snapshot a6e665a9-19d5-4924-aed6-2c120c85677c of volume b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] snapshot_file for this snap is: volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a97c8f-e7f5-4be9-ac9f-cfbc90bc0bf8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:27 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:27 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (be5d0e98-d987-4d3b-9ebd-491bdf88c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc659a18-b1a9-47b3-a98c-d427dcb6408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc659a18-b1a9-47b3-a98c-d427dcb6408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397350618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d326844f-c706-47eb-8728-c67cdc1739aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:28Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6600f-5a8b-4811-845f-d44889612797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed6600f-5a8b-4811-845f-d44889612797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12408ceb-0eb7-4fc0-89fa-935410a17e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12408ceb-0eb7-4fc0-89fa-935410a17e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd326844f-c706-47eb-8728-c67cdc1739aa', 'volume_name': 'volume-d326844f-c706-47eb-8728-c67cdc1739aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:28 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539ed265-7132-46ca-b1d8-744f820b8f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539ed265-7132-46ca-b1d8-744f820b8f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be0a845-9fdd-4925-96bd-ed9147b1f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:28 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Volume d326844f-c706-47eb-8728-c67cdc1739aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d326844f-c706-47eb-8728-c67cdc1739aa', 'volume_size': 1} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397350618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d326844f-c706-47eb-8728-c67cdc1739aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:28Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Creating volume d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:28 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.483s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:28 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa 1073741824 Aug 28 16:37:28 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f727aee-5c8d-4c78-a6f8-0a676895a620]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:28 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:28 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:28 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa 1073741824" returned: 0 in 0.539s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:28 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa Aug 28 16:37:28 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:29 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.739s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:29 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:29 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:29 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa" returned: 0 in 0.314s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be0a845-9fdd-4925-96bd-ed9147b1f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d326844f-c706-47eb-8728-c67cdc1739aa', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765ced4c-4133-477a-ae12-acffc5e19e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:29 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Volume volume-d326844f-c706-47eb-8728-c67cdc1739aa (d326844f-c706-47eb-8728-c67cdc1739aa): created successfully Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765ced4c-4133-477a-ae12-acffc5e19e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (be5d0e98-d987-4d3b-9ebd-491bdf88c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3ec1cad3-0ced-45a5-a779-726e1388bd6b tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.400s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:29 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c Aug 28 16:37:29 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:29 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b.a6e665a9-19d5-4924-aed6-2c120c85677c" returned: 0 in 0.276s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-a6e665a9-19d5-4924-aed6-2c120c85677c" released by "_delete_snapshot" :: held 2.035s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" released by "delete_snapshot" :: held 2.067s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Created reservations ['79c63657-607e-4a33-8aa5-9ad5e1ac24c1', '603f58f3-529b-4449-8279-60637398aa38', 'ff759361-6891-4c50-ae54-e6a9e0dfc2ee', '2fe29809-1b58-41c5-9714-9abc69361490'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:29 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Delete snapshot completed successfully. Aug 28 16:37:29 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-86f80099-7a13-4864-a7fc-d02dc6c15b55 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-a6e665a9-19d5-4924-aed6-2c120c85677c-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b of volume d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d12545-5a42-4365-ad54-42d496d8fd94]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:30 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa Aug 28 16:37:30 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:30 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa" returned: 0 in 0.427s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-b288c65f-e756-483a-b0d6-f2a8500d3b7b-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:30 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b 1G Aug 28 16:37:31 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-b288c65f-e756-483a-b0d6-f2a8500d3b7b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[225809b1-8bb8-4624-b24c-3c5423bb59d3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:31 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:31 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:31 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b 1G" returned: 0 in 0.505s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d326844f-c706-47eb-8728-c67cdc1739aa -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:31 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:31 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d326844f-c706-47eb-8728-c67cdc1739aa -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b Aug 28 16:37:31 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.443s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:31 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b Aug 28 16:37:31 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.311s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:37:31 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d326844f-c706-47eb-8728-c67cdc1739aa -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" returned: 0 in 0.387s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:31 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b is being set with open permissions: ugo+rw Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:31 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b Aug 28 16:37:31 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:31 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-b288c65f-e756-483a-b0d6-f2a8500d3b7b" returned: 0 in 0.339s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-b288c65f-e756-483a-b0d6-f2a8500d3b7b" released by "delete_volume" :: held 0.864s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Created reservations ['e9ef49f8-6f16-4288-b500-e279cb4b4d24', '5ef4ef7b-c3bb-4cf1-ad15-ce60291c88fd', 'ecd13aaa-5105-4c9e-bea8-66001c1b2928', '1d39f67f-f00a-4f95-beee-0d7fa5cfb87c'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:32 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:32 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-25b9dc53-4d86-4649-821b-5b02d6a83ddd-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-25b9dc53-4d86-4649-821b-5b02d6a83ddd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:32 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info Aug 28 16:37:32 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" acquired by "delete_volume" :: waited 0.024s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272c47c-4dfb-49c8-b783-df45beebc283]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:32 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.352s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Deleted volume successfully. Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c239396b-4f20-49dd-9db7-0fae912a1e63 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-b288c65f-e756-483a-b0d6-f2a8500d3b7b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:32 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info" returned: 0 in 0.300s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:32 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info is being set with open permissions: ugo+rw Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:32 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd Aug 28 16:37:32 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:32 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info Aug 28 16:37:32 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:32 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.info" returned: 0 in 0.310s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:32 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-18ed44e8-5d6b-4674-8526-a26aedd3b00e tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:32 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd" returned: 0 in 0.550s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:32 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd Aug 28 16:37:32 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:33 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-25b9dc53-4d86-4649-821b-5b02d6a83ddd" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-quobyte-25b9dc53-4d86-4649-821b-5b02d6a83ddd" released by "delete_volume" :: held 0.866s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Created reservations ['14b89da7-f949-42e4-8830-e6c5ff08c4ea', '29677e27-3788-4422-8e65-6f83f79f8561', '813d75e2-2163-4a61-909d-2bd10bf73838', '324867d5-7c06-46ae-b1a4-0a73115ff872'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:33 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:33 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:33 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.293s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Deleted volume successfully. Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-6ba35cbe-237a-47b4-ac94-0ec55df83e52 tempest-SnapshotDependencyTests-1192410893 None] Lock "cinder-25b9dc53-4d86-4649-821b-5b02d6a83ddd-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b of volume d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[386737cd-1f5f-4fee-ae6f-537ab0e08636]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:34 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b Aug 28 16:37:34 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:34 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" returned: 0 in 0.398s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d326844f-c706-47eb-8728-c67cdc1739aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f9075d-0c9f-4c27-85c3-d9c94da3237d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:34 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa Aug 28 16:37:34 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:34 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:34 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b Aug 28 16:37:34 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:35 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" returned: 0 in 0.367s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:35 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b Aug 28 16:37:35 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:35 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa.bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" returned: 0 in 0.283s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b" released by "_delete_snapshot" :: held 1.532s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" released by "delete_snapshot" :: held 1.558s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Created reservations ['3ba77b35-be1b-43c7-9669-705f59d5ebf4', 'c669b950-e93c-4e79-991c-7a29de0c0beb', '81c3c03e-d03a-4025-ad51-bc221f721bf7', '0965dab7-02a5-4918-be2a-369386e16294'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b875a675-feb0-49b9-ab41-f2d7331fdea3 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-bf0af3eb-23b0-4f75-81b2-abf8fd3e3f2b-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-d326844f-c706-47eb-8728-c67cdc1739aa-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "cinder-d326844f-c706-47eb-8728-c67cdc1739aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77759d5-780c-44eb-832e-8175b659fe75]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:36 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa Aug 28 16:37:36 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:36 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa" returned: 0 in 0.347s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:36 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa Aug 28 16:37:36 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:36 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-d326844f-c706-47eb-8728-c67cdc1739aa" returned: 0 in 0.240s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-d326844f-c706-47eb-8728-c67cdc1739aa" released by "delete_volume" :: held 0.655s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Created reservations ['7ac3b6c2-82db-427b-a611-779247c1fc86', 'e23fa15f-903f-4ecd-b87c-683240616eb2', 'ca4fc315-0965-4254-83f3-26b2a435c17e', '2f30167c-53cb-47ba-b2af-f7ab09ba5261'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:36 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:36 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:37 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.302s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1ef0fbd9-afcd-440c-8e76-7dbbc7119a5a tempest-ProjectMemberTests-1795725571 None] Lock "cinder-d326844f-c706-47eb-8728-c67cdc1739aa-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (76f78a35-8f2b-4482-8aa8-f23f9d92a1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b729cccb-64b0-4665-b36f-7df7c1ed44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b729cccb-64b0-4665-b36f-7df7c1ed44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096737851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c1186f-f093-4f43-9ac7-79e2107353e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:38Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e858c-df5c-4540-ad6d-2d616aad9b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113e858c-df5c-4540-ad6d-2d616aad9b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b5d01a-d5b2-4c54-be9c-7ebcd879de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b5d01a-d5b2-4c54-be9c-7ebcd879de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c1186f-f093-4f43-9ac7-79e2107353e5', 'volume_name': 'volume-f5c1186f-f093-4f43-9ac7-79e2107353e5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eec94d-6051-4e65-85d9-23a16ec94ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eec94d-6051-4e65-85d9-23a16ec94ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf49bb4-5e44-4da0-bf0c-936bbe05a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:37 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Volume f5c1186f-f093-4f43-9ac7-79e2107353e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c1186f-f093-4f43-9ac7-79e2107353e5', 'volume_size': 1} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1096737851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c1186f-f093-4f43-9ac7-79e2107353e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:38Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Creating volume f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:37 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:37 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 1073741824 Aug 28 16:37:37 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:38 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 1073741824" returned: 0 in 0.473s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:38 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 Aug 28 16:37:38 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:38 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5" returned: 0 in 0.255s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf49bb4-5e44-4da0-bf0c-936bbe05a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c1186f-f093-4f43-9ac7-79e2107353e5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d4f6f-e80f-4a5e-b768-fd99eae5a83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:38 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Volume volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 (f5c1186f-f093-4f43-9ac7-79e2107353e5): created successfully Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4d4f6f-e80f-4a5e-b768-fd99eae5a83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:38 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (76f78a35-8f2b-4482-8aa8-f23f9d92a1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:38 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8bb89441-18d3-4e68-9120-967616dce463 tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 21e32fc8-1e77-461f-97b1-a5cd2ff09c4b of volume f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1341f2-a4fa-4f2e-bf2e-ede867d1b76e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:40 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 Aug 28 16:37:40 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:40 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:40 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b 1G Aug 28 16:37:40 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:40 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b 1G" returned: 0 in 0.462s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:40 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b Aug 28 16:37:40 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:41 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" returned: 0 in 0.320s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:41 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b is being set with open permissions: ugo+rw Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:41 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b Aug 28 16:37:41 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:41 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:41 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info Aug 28 16:37:41 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:41 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:41 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info is being set with open permissions: ugo+rw Aug 28 16:37:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:41 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info Aug 28 16:37:41 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:42 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.info" returned: 0 in 0.264s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-73a8bc3e-4e38-458c-b9ed-eca743a8a1d2 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 21e32fc8-1e77-461f-97b1-a5cd2ff09c4b of volume f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b973a-33af-4a37-a037-c713d63648f0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:43 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b Aug 28 16:37:43 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:43 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" returned: 0 in 0.390s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5c1186f-f093-4f43-9ac7-79e2107353e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d0213-f660-420a-976e-762dabc7bb8b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:43 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 Aug 28 16:37:43 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:44 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5" returned: 0 in 0.381s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:44 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b Aug 28 16:37:44 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:44 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" returned: 0 in 0.353s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:44 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b Aug 28 16:37:44 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:44 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5.21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b" released by "_delete_snapshot" :: held 1.479s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" released by "delete_snapshot" :: held 1.503s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Created reservations ['230a2e33-a18e-4dd3-90db-ffc7c65de0c7', '823a9795-3a82-4416-a45a-3f5de8d5c938', 'bb3767c8-b924-480c-884a-664f820f1392', '4d3f7332-1c79-4a67-9182-24616a05a0d8'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-de026e9d-2afb-459d-85dc-dfc0880c8b81 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-21e32fc8-1e77-461f-97b1-a5cd2ff09c4b-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-f5c1186f-f093-4f43-9ac7-79e2107353e5-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-f5c1186f-f093-4f43-9ac7-79e2107353e5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee5458-fa9e-470d-be1a-876272c67ce2]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:45 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 Aug 28 16:37:45 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:45 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5" returned: 0 in 0.357s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:45 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5 Aug 28 16:37:45 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:46 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f5c1186f-f093-4f43-9ac7-79e2107353e5" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f5c1186f-f093-4f43-9ac7-79e2107353e5" released by "delete_volume" :: held 0.652s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Created reservations ['f07b23d6-dc5f-4530-b5cb-86e14a8064b6', 'fa187a86-f44c-48d0-85dc-8b954af7c1c4', '031dc39f-3173-4b7f-98cd-db7613432acb', '649845b2-e07d-4838-90e9-15c0976c13ac'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:46 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:46 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:46 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-2116b3ba-62c9-4f3b-82d3-6b8455e84ef8 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-f5c1186f-f093-4f43-9ac7-79e2107353e5-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (ed2e03ce-df2a-46fe-b5b7-87b2914f377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830d9f5e-d4dd-4a9a-93b4-57cf4a432031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830d9f5e-d4dd-4a9a-93b4-57cf4a432031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733505600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2671ee6-5a57-46f7-bcb9-650d21d2f46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:47Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5202e0-5eb4-4d93-afc1-9567aead30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5202e0-5eb4-4d93-afc1-9567aead30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b7d44f-9483-4c1b-b3aa-27651a67f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b7d44f-9483-4c1b-b3aa-27651a67f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2671ee6-5a57-46f7-bcb9-650d21d2f46d', 'volume_name': 'volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f4e046-281e-4acd-bb7d-860e05b86bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f4e046-281e-4acd-bb7d-860e05b86bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6b50e3-d639-4702-b4fb-5b99ded01d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:46 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Volume a2671ee6-5a57-46f7-bcb9-650d21d2f46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d', 'volume_size': 1} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733505600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2671ee6-5a57-46f7-bcb9-650d21d2f46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:47Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Creating volume a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:46 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:46 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:47 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d 1073741824 Aug 28 16:37:47 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:47 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d 1073741824" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:47 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d Aug 28 16:37:47 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:47 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" returned: 0 in 0.248s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6b50e3-d639-4702-b4fb-5b99ded01d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff71f0c-3b83-4350-ad5c-8dc1c33c7be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:47 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Volume volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d (a2671ee6-5a57-46f7-bcb9-650d21d2f46d): created successfully Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff71f0c-3b83-4350-ad5c-8dc1c33c7be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:47 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (ed2e03ce-df2a-46fe-b5b7-87b2914f377e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:47 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-87e6355d-974b-420c-82da-39f73a0de26e tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot bc99bfbb-54ba-46b0-90b2-52cca12f5d50 of volume a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a6455-7734-4b67-80b6-b251d8482185]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:48 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d Aug 28 16:37:48 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:48 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" returned: 0 in 0.370s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:48 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 1G Aug 28 16:37:48 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:48 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 1G" returned: 0 in 0.396s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:48 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:48 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 Aug 28 16:37:48 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:49 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50" returned: 0 in 0.310s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:49 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 is being set with open permissions: ugo+rw Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:49 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 Aug 28 16:37:49 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:49 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50" returned: 0 in 0.251s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:49 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info Aug 28 16:37:49 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:49 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:49 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info is being set with open permissions: ugo+rw Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:49 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info Aug 28 16:37:49 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:49 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.info" returned: 0 in 0.248s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:49 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:50 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-45117df4-84a0-4d8a-8821-2d1d11ec577e tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-bc99bfbb-54ba-46b0-90b2-52cca12f5d50-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-bc99bfbb-54ba-46b0-90b2-52cca12f5d50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-bc99bfbb-54ba-46b0-90b2-52cca12f5d50" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-bc99bfbb-54ba-46b0-90b2-52cca12f5d50" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot bc99bfbb-54ba-46b0-90b2-52cca12f5d50 of volume a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[42618bc1-fcf1-4176-87e8-15d0ea6ea193]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:50 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 Aug 28 16:37:50 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:50 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[42824cbf-cc50-47d7-8c65-9c0afa683291]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:50 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:50 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d Aug 28 16:37:50 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:51 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" returned: 0 in 0.348s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:51 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 Aug 28 16:37:51 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:51 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:51 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50 Aug 28 16:37:51 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:51 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d.bc99bfbb-54ba-46b0-90b2-52cca12f5d50" returned: 0 in 0.237s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-bc99bfbb-54ba-46b0-90b2-52cca12f5d50" released by "_delete_snapshot" :: held 1.329s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" released by "delete_snapshot" :: held 1.350s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Created reservations ['a68c80cb-ce03-4df1-b661-f85f82bfc7b0', '1a4be9c9-5d15-40de-8201-953515bad233', '82835faa-8a08-47dd-870a-31cac28227e1', '034d520a-e355-41d9-bbf8-3e436d5bdbbd'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:51 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:51 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-1beed6f6-f2cf-461a-8317-79aa79173e70 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-bc99bfbb-54ba-46b0-90b2-52cca12f5d50-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-a2671ee6-5a57-46f7-bcb9-650d21d2f46d-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-a2671ee6-5a57-46f7-bcb9-650d21d2f46d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[da61e377-f327-44a5-aae0-4f8094fbe211]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:52 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d Aug 28 16:37:52 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:52 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" returned: 0 in 0.361s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:52 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:52 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d Aug 28 16:37:52 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:53 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a2671ee6-5a57-46f7-bcb9-650d21d2f46d" released by "delete_volume" :: held 0.655s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Created reservations ['c630c28d-ef24-4556-9e39-03ea41302694', 'aa759ba9-8b53-47ec-82f2-5870a592ac9e', '0e0f3228-8245-4248-8d4c-af6137812d6f', '6580e50a-7caa-44ad-91ec-05024a5a7192'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:53 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:37:53 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:37:53 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-82156126-fae1-47f3-86a0-147415e21207 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-a2671ee6-5a57-46f7-bcb9-650d21d2f46d-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (f5ac6358-8e22-4326-bb9e-c2589bb75aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5768ed17-bd92-4125-b742-1000e83ceec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5768ed17-bd92-4125-b742-1000e83ceec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523690784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4864b36f-019b-4393-b157-6439e7d286a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:54Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7c700a-9611-4985-9394-2390d2baf83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7c700a-9611-4985-9394-2390d2baf83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:53 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2131-7389-4202-8d23-9398bcc16752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ff2131-7389-4202-8d23-9398bcc16752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4864b36f-019b-4393-b157-6439e7d286a6', 'volume_name': 'volume-4864b36f-019b-4393-b157-6439e7d286a6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7472af9-6fcd-40ac-92c7-a71a4597d44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7472af9-6fcd-40ac-92c7-a71a4597d44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac688b00-1bb9-4a2a-a226-53d5fbbc11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:54 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Volume 4864b36f-019b-4393-b157-6439e7d286a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4864b36f-019b-4393-b157-6439e7d286a6', 'volume_size': 1} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523690784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4864b36f-019b-4393-b157-6439e7d286a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:37:54Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Creating volume 4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:37:54 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:54 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 1073741824 Aug 28 16:37:54 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:54 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 1073741824" returned: 0 in 0.403s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:54 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 Aug 28 16:37:54 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:54 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6" returned: 0 in 0.238s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac688b00-1bb9-4a2a-a226-53d5fbbc11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4864b36f-019b-4393-b157-6439e7d286a6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd154fe6-1508-4ba5-9679-7fbe5992d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:37:54 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Volume volume-4864b36f-019b-4393-b157-6439e7d286a6 (4864b36f-019b-4393-b157-6439e7d286a6): created successfully Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd154fe6-1508-4ba5-9679-7fbe5992d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:37:54 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (f5ac6358-8e22-4326-bb9e-c2589bb75aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:37:54 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-9716ecb3-4935-4d0e-87c7-87042abd56b1 tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot 69a8e7ca-148d-4f54-8898-0ea176931b02 of volume 4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2810dd8-429b-450b-8c6a-c8dc0484868a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:55 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 Aug 28 16:37:55 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:55 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:55 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 1G Aug 28 16:37:55 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:55 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 1G" returned: 0 in 0.389s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:55 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4864b36f-019b-4393-b157-6439e7d286a6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:55 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4864b36f-019b-4393-b157-6439e7d286a6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 Aug 28 16:37:55 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:56 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4864b36f-019b-4393-b157-6439e7d286a6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02" returned: 0 in 0.278s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:56 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 is being set with open permissions: ugo+rw Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:56 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 Aug 28 16:37:56 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:56 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02" returned: 0 in 0.238s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=160,cinder:INSERT=64,cinder:UPDATE=191,cinder:DELETE=15 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=154,cinder:INSERT=50,cinder:UPDATE=206,cinder:DELETE=17 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:56 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info Aug 28 16:37:56 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:56 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:56 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info is being set with open permissions: ugo+rw Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:56 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info Aug 28 16:37:56 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:56 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.info" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:56 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:37:56 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-06fc54d5-b7d5-4d0f-99cb-b396fdaae552 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-69a8e7ca-148d-4f54-8898-0ea176931b02-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-69a8e7ca-148d-4f54-8898-0ea176931b02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-69a8e7ca-148d-4f54-8898-0ea176931b02" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-69a8e7ca-148d-4f54-8898-0ea176931b02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot 69a8e7ca-148d-4f54-8898-0ea176931b02 of volume 4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5a920-707b-41fb-a149-02f3402cdfd6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:57 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 Aug 28 16:37:57 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:57 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4864b36f-019b-4393-b157-6439e7d286a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6321e8-41aa-45a8-9afe-cf160583453c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:57 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 Aug 28 16:37:57 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:58 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6" returned: 0 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:58 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 Aug 28 16:37:58 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:58 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02" returned: 0 in 0.317s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:58 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02 Aug 28 16:37:58 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:58 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6.69a8e7ca-148d-4f54-8898-0ea176931b02" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-69a8e7ca-148d-4f54-8898-0ea176931b02" released by "_delete_snapshot" :: held 1.361s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" released by "delete_snapshot" :: held 1.382s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Created reservations ['92b8ed92-25c5-4757-8ce8-49023f38f176', '7317a4fd-fa92-41ed-8498-8d80b389537c', 'e2677355-da61-4b1b-b445-3edf3dd9955b', 'd7d1c5d4-0aeb-488f-ae38-70c7b6aa3aae'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:37:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:37:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4f9d1aec-fe1f-4b48-9c18-d58cce8bbc25 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-69a8e7ca-148d-4f54-8898-0ea176931b02-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-4864b36f-019b-4393-b157-6439e7d286a6-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-4864b36f-019b-4393-b157-6439e7d286a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef562fe-03fa-48d0-a05e-bbf96932e85a]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:59 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 Aug 28 16:37:59 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:37:59 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:37:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:37:59 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6 Aug 28 16:37:59 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:00 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4864b36f-019b-4393-b157-6439e7d286a6" returned: 0 in 0.234s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-4864b36f-019b-4393-b157-6439e7d286a6" released by "delete_volume" :: held 0.635s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Created reservations ['5a01c654-92a7-4e82-94f2-3bc6ea625581', '615df7fe-a7bc-4462-b758-214ed1227216', '974634f1-75c4-437b-ab13-d33dc416d571', '70db9389-1b34-4d9f-8434-ddcc790c2416'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:00 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:00 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:00 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:00 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-e65ca299-7d69-4e98-9394-51551fccd2e5 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-4864b36f-019b-4393-b157-6439e7d286a6-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (8ce89993-af45-4ad1-9c9c-530ad7624c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d03c0f-3bb6-4deb-ab15-3b5e6dad23a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d03c0f-3bb6-4deb-ab15-3b5e6dad23a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334206595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4280d8f-3acd-4aa9-b5ce-3cf6c7278044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:01Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c121f1a-2287-41ce-a4c1-490c9123b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c121f1a-2287-41ce-a4c1-490c9123b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be42013-c785-40d1-a479-5177a45d9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be42013-c785-40d1-a479-5177a45d9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4280d8f-3acd-4aa9-b5ce-3cf6c7278044', 'volume_name': 'volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a1bb04-37f8-436c-ae50-8a6bcda3827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a1bb04-37f8-436c-ae50-8a6bcda3827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d58ccf-3532-4f45-8b08-b0dc40a3cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Volume a4280d8f-3acd-4aa9-b5ce-3cf6c7278044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044', 'volume_size': 1} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334206595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4280d8f-3acd-4aa9-b5ce-3cf6c7278044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebc93b6bca243509f224a8a35fdf4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:01Z,use_quota=True,user_id='55e4ffc154844eed866503c6e225eb35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Creating volume a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:01 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:01 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 1073741824 Aug 28 16:38:01 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:01 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 1073741824" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:01 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 Aug 28 16:38:01 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:01 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d58ccf-3532-4f45-8b08-b0dc40a3cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359914b1-4a18-4182-83ef-eed00271d43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Volume volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 (a4280d8f-3acd-4aa9-b5ce-3cf6c7278044): created successfully Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359914b1-4a18-4182-83ef-eed00271d43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Flow 'volume_create_manager' (8ce89993-af45-4ad1-9c9c-530ad7624c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-496bf510-442b-4ba1-b885-c9a313edec2e tempest-ProjectMemberTests-1795725571 None] Created volume successfully. Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Creating offline snapshot f24fc80d-441d-49d7-86f3-e9f9a2102152 of volume a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f77d63d-fd06-4bbf-980d-fdcec3eaa39b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:02 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 Aug 28 16:38:02 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:02 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" returned: 0 in 0.340s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:02 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 1G Aug 28 16:38:02 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:02 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 1G" returned: 0 in 0.406s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:02 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 Aug 28 16:38:02 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:03 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152" returned: 0 in 0.299s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:03 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 is being set with open permissions: ugo+rw Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:03 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 Aug 28 16:38:03 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:03 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:03 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info Aug 28 16:38:03 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:03 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info" returned: 0 in 0.244s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:03 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info is being set with open permissions: ugo+rw Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:03 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info Aug 28 16:38:03 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:03 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.info" returned: 0 in 0.239s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:03 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:04 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-18e6e595-8eb5-4eb6-92be-f07d07fe7152 tempest-ProjectMemberTests-1795725571 None] Create snapshot completed successfully Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-f24fc80d-441d-49d7-86f3-e9f9a2102152-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-f24fc80d-441d-49d7-86f3-e9f9a2102152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-f24fc80d-441d-49d7-86f3-e9f9a2102152" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f24fc80d-441d-49d7-86f3-e9f9a2102152" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Deleting offline snapshot f24fc80d-441d-49d7-86f3-e9f9a2102152 of volume a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] snapshot_file for this snap is: volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ff636-4578-4f7b-bb93-54cf594fc533]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:04 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 Aug 28 16:38:04 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:04 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152" returned: 0 in 0.341s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9516b7a-fa63-45ab-ae0e-efebf31e8a22]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:04 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:04 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 Aug 28 16:38:04 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:05 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" returned: 0 in 0.354s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:05 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 Aug 28 16:38:05 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:05 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152" returned: 0 in 0.313s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:05 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152 Aug 28 16:38:05 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:05 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044.f24fc80d-441d-49d7-86f3-e9f9a2102152" returned: 0 in 0.252s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-f24fc80d-441d-49d7-86f3-e9f9a2102152" released by "_delete_snapshot" :: held 1.352s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" released by "delete_snapshot" :: held 1.370s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Created reservations ['550511bd-b510-4498-9557-03ca5fb37a88', '84899236-375b-4917-811f-f887a6cb54d2', 'a75a07cd-18d5-414f-8998-f23fe658fb91', 'aeb95b57-a417-4255-8d3d-175e4d211762'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:05 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Delete snapshot completed successfully. Aug 28 16:38:05 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-00e66693-a1f3-41a7-bcfa-9bfd18bfc4f6 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-f24fc80d-441d-49d7-86f3-e9f9a2102152-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ba9b5-5e56-43e2-b394-a896359b94ba]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:06 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 Aug 28 16:38:06 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:06 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" returned: 0 in 0.345s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:06 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044 Aug 28 16:38:06 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:07 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" returned: 0 in 0.237s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-quobyte-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044" released by "delete_volume" :: held 0.636s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Created reservations ['4f782161-5530-476d-b417-9562d7de2767', '0a33c352-b22a-4f3f-8d45-43eac02e3d71', '78f31b32-3f2f-4265-86c7-8e8a44303ca4', '0fab1aa0-57ff-49ca-9d43-901d4c5ca1eb'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:07 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:07 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:07 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Deleted volume successfully. Aug 28 16:38:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-325d21bc-45f5-4a12-983c-33d51b18e815 tempest-ProjectMemberTests-1795725571 None] Lock "cinder-a4280d8f-3acd-4aa9-b5ce-3cf6c7278044-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (bd1f2ba9-fc53-4b8d-be9f-05ef83578e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0172f195-0f59-4c06-a47c-28ede04c161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0172f195-0f59-4c06-a47c-28ede04c161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116860556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63d2ada-1b68-4f43-bbde-c42e9196dd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:11Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18114969-6607-4761-8079-93871c635f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18114969-6607-4761-8079-93871c635f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bafdaad-ad9e-422a-9707-a8ebae2f940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bafdaad-ad9e-422a-9707-a8ebae2f940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63d2ada-1b68-4f43-bbde-c42e9196dd61', 'volume_name': 'volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7409978-d741-45e8-8b33-a27025a607e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7409978-d741-45e8-8b33-a27025a607e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4c2662-e92c-47aa-9250-227d1406bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Volume c63d2ada-1b68-4f43-bbde-c42e9196dd61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61', 'volume_size': 1} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116860556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63d2ada-1b68-4f43-bbde-c42e9196dd61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:11Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Creating volume c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:11 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 1073741824 Aug 28 16:38:11 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:11 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 1073741824" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:11 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 Aug 28 16:38:11 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:11 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61" returned: 0 in 0.237s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4c2662-e92c-47aa-9250-227d1406bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1041fe23-03c4-44bb-90f2-6d051784ee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Volume volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 (c63d2ada-1b68-4f43-bbde-c42e9196dd61): created successfully Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1041fe23-03c4-44bb-90f2-6d051784ee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (bd1f2ba9-fc53-4b8d-be9f-05ef83578e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5475e100-ffc9-4d8f-9c70-002dd204df06 tempest-ProjectReaderTests-1754453674 None] Created volume successfully. Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Creating offline snapshot 217d79d4-a70b-4a52-affc-5636a73201b1 of volume c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[809e9d73-5c61-42a1-b7f0-09286548c7cf]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:12 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 Aug 28 16:38:12 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:12 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:12 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 1G Aug 28 16:38:12 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:13 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 1G" returned: 0 in 0.404s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:13 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 Aug 28 16:38:13 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:13 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1" returned: 0 in 0.292s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:13 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 is being set with open permissions: ugo+rw Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:13 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 Aug 28 16:38:13 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:13 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1" returned: 0 in 0.238s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:13 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info Aug 28 16:38:13 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:13 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info" returned: 0 in 0.240s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:14 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info is being set with open permissions: ugo+rw Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:14 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info Aug 28 16:38:14 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:14 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.info" returned: 0 in 0.268s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-1abe9e89-97e2-4f3d-a1a5-67ae8930cc67 tempest-ProjectReaderTests-1754453674 None] Create snapshot completed successfully Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-217d79d4-a70b-4a52-affc-5636a73201b1-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-217d79d4-a70b-4a52-affc-5636a73201b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-217d79d4-a70b-4a52-affc-5636a73201b1" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-217d79d4-a70b-4a52-affc-5636a73201b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Deleting offline snapshot 217d79d4-a70b-4a52-affc-5636a73201b1 of volume c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] snapshot_file for this snap is: volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e2aa23-e91a-46e4-87fc-e3e3665f48c0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:14 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 Aug 28 16:38:14 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:15 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1" returned: 0 in 0.376s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca7ae4f-66e0-4850-b0fd-791741ca4aad]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:15 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 Aug 28 16:38:15 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:15 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:15 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 Aug 28 16:38:15 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:15 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1" returned: 0 in 0.315s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:15 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1 Aug 28 16:38:15 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:16 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61.217d79d4-a70b-4a52-affc-5636a73201b1" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-217d79d4-a70b-4a52-affc-5636a73201b1" released by "_delete_snapshot" :: held 1.372s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" released by "delete_snapshot" :: held 1.394s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Created reservations ['e43ea36f-98ea-4207-913e-b866398e2e5c', '9a7822ca-704b-4fd8-bb59-b7ae68ca41bc', '3d85a5bc-c0f8-47e5-8151-1a1fc6bd2b69', '5a6e0fb6-6bc5-488b-ae99-a765e58126d9'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:16 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Delete snapshot completed successfully. Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-93824fa2-cbe4-4106-a846-01c4372793d0 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-217d79d4-a70b-4a52-affc-5636a73201b1-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-c63d2ada-1b68-4f43-bbde-c42e9196dd61-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-c63d2ada-1b68-4f43-bbde-c42e9196dd61-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d5965-e441-4c06-ae1a-6ae88ff7cf04]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:16 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:17 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 Aug 28 16:38:17 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:17 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61" returned: 0 in 0.365s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:17 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61 Aug 28 16:38:17 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:17 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-c63d2ada-1b68-4f43-bbde-c42e9196dd61" returned: 0 in 0.243s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-c63d2ada-1b68-4f43-bbde-c42e9196dd61" released by "delete_volume" :: held 0.667s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Created reservations ['cce2eff5-7090-4ac4-b68d-52f01635a13d', 'cc781ac8-2939-4878-86ed-5987379788cb', 'f110c56f-5747-45bd-a98a-1f05ae9f71ba', '5e973a8e-12c5-4da1-90db-4e85787b4241'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:17 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:17 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:17 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.260s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:17 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Deleted volume successfully. Aug 28 16:38:17 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-bbed1ab8-168d-4c75-8d4a-64f69d85a272 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-c63d2ada-1b68-4f43-bbde-c42e9196dd61-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (e30413e7-312d-41ad-aa88-eff9175a47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a822ec-bd9e-44d0-b8dc-b1f317cedf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a822ec-bd9e-44d0-b8dc-b1f317cedf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771878944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32f0115-7e2e-4120-8920-849dbc3779d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:18Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39bcc97-a400-49e3-9105-9241cb470b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39bcc97-a400-49e3-9105-9241cb470b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e710a348-ae3a-4795-bd57-e940fb93325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e710a348-ae3a-4795-bd57-e940fb93325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32f0115-7e2e-4120-8920-849dbc3779d6', 'volume_name': 'volume-f32f0115-7e2e-4120-8920-849dbc3779d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f9f61-d0f3-46b4-93fd-55f9f8f93875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f9f61-d0f3-46b4-93fd-55f9f8f93875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b6a4ae-6acc-4c9f-a60b-d507615f36d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:18 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Volume f32f0115-7e2e-4120-8920-849dbc3779d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32f0115-7e2e-4120-8920-849dbc3779d6', 'volume_size': 1} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771878944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32f0115-7e2e-4120-8920-849dbc3779d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:18Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Creating volume f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:18 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:18 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 1073741824 Aug 28 16:38:18 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:18 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 1073741824" returned: 0 in 0.436s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:18 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:18 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 Aug 28 16:38:18 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:19 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b6a4ae-6acc-4c9f-a60b-d507615f36d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32f0115-7e2e-4120-8920-849dbc3779d6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3e922-bac8-4059-966b-ee37f5761a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:19 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Volume volume-f32f0115-7e2e-4120-8920-849dbc3779d6 (f32f0115-7e2e-4120-8920-849dbc3779d6): created successfully Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d3e922-bac8-4059-966b-ee37f5761a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (e30413e7-312d-41ad-aa88-eff9175a47e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:19 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a75344b4-32c8-4d88-9821-705672e84588 tempest-ProjectReaderTests-1754453674 None] Created volume successfully. Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Creating offline snapshot 7c7c6e54-48c7-4d3a-9dd5-834c69a84023 of volume f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[40257f1c-c846-435a-b356-ae36406630f7]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:19 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 Aug 28 16:38:19 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:19 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6" returned: 0 in 0.372s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:19 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:19 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 1G Aug 28 16:38:19 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:20 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 1G" returned: 0 in 0.382s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32f0115-7e2e-4120-8920-849dbc3779d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:20 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32f0115-7e2e-4120-8920-849dbc3779d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 Aug 28 16:38:20 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:20 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32f0115-7e2e-4120-8920-849dbc3779d6 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023" returned: 0 in 0.304s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:20 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 is being set with open permissions: ugo+rw Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:20 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 Aug 28 16:38:20 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:20 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023" returned: 0 in 0.257s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:20 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:20 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info Aug 28 16:38:20 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:21 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info" returned: 0 in 0.251s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:21 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info is being set with open permissions: ugo+rw Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:21 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info Aug 28 16:38:21 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:21 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.info" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:21 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-cb3f55c0-4ae8-42de-af08-34146d2f43e5 tempest-ProjectReaderTests-1754453674 None] Create snapshot completed successfully Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-7c7c6e54-48c7-4d3a-9dd5-834c69a84023-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-7c7c6e54-48c7-4d3a-9dd5-834c69a84023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-7c7c6e54-48c7-4d3a-9dd5-834c69a84023" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-7c7c6e54-48c7-4d3a-9dd5-834c69a84023" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Deleting offline snapshot 7c7c6e54-48c7-4d3a-9dd5-834c69a84023 of volume f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] snapshot_file for this snap is: volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e8c4a-5888-41ca-948f-ee4f6bb960f8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:21 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:21 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 Aug 28 16:38:21 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:22 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023" returned: 0 in 0.364s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32f0115-7e2e-4120-8920-849dbc3779d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c70e83b-6c79-4d72-bb33-5a74bc13e35b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:22 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 Aug 28 16:38:22 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:22 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6" returned: 0 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:22 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 Aug 28 16:38:22 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:22 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:22 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:22 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023 Aug 28 16:38:22 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:23 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6.7c7c6e54-48c7-4d3a-9dd5-834c69a84023" returned: 0 in 0.246s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-7c7c6e54-48c7-4d3a-9dd5-834c69a84023" released by "_delete_snapshot" :: held 1.378s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" released by "delete_snapshot" :: held 1.399s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Created reservations ['7a9e053c-90a2-498b-9a65-5c0f62f2ff4e', '9941f008-e8b0-467a-8e27-acab02b2b4b9', '2d93c25f-68f9-4313-a92d-32b2508095e9', '6fd484f4-c1b8-40a8-82a7-9d0d13a3ff46'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:23 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Delete snapshot completed successfully. Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5f288dde-d0e6-4227-ba07-7df09a4cbf44 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-7c7c6e54-48c7-4d3a-9dd5-834c69a84023-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-f32f0115-7e2e-4120-8920-849dbc3779d6-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-f32f0115-7e2e-4120-8920-849dbc3779d6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" acquired by "delete_volume" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8843ce-d1b1-46f9-b1cc-5d19e5cd9a28]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:23 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:24 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 Aug 28 16:38:24 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:24 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6" returned: 0 in 0.356s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:24 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6 Aug 28 16:38:24 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:24 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-f32f0115-7e2e-4120-8920-849dbc3779d6" returned: 0 in 0.232s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-f32f0115-7e2e-4120-8920-849dbc3779d6" released by "delete_volume" :: held 0.643s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Created reservations ['859edc4e-1f64-461d-9c16-c91e8a64e57a', 'cad5b63d-840b-41e5-a65d-7f399b683736', '00c77d59-a0c5-47c4-9fb2-00c7ac01d2f8', 'f494fe99-a8c8-4f04-ae4d-c45c05e846ef'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:24 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:24 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:24 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.232s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:24 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Deleted volume successfully. Aug 28 16:38:24 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-5ccae783-203d-4382-bda4-3b65a93df3a6 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-f32f0115-7e2e-4120-8920-849dbc3779d6-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (984c4822-9c8d-48d3-ae0f-b52e8db13ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed40f58-28ca-42e7-abfa-6acda746354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed40f58-28ca-42e7-abfa-6acda746354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033066508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19554bdf-d25c-4ede-9218-bef2194f8038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:25Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7337ab-7df1-480c-95aa-c089965a6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7337ab-7df1-480c-95aa-c089965a6062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b38652-41cc-4c3f-ad20-b9ed1b71e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b38652-41cc-4c3f-ad20-b9ed1b71e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19554bdf-d25c-4ede-9218-bef2194f8038', 'volume_name': 'volume-19554bdf-d25c-4ede-9218-bef2194f8038', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1bb831-43b4-477d-907e-1d0da406e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1bb831-43b4-477d-907e-1d0da406e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea327b6-cb5b-4bb5-89fc-a0a98081cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:25 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Volume 19554bdf-d25c-4ede-9218-bef2194f8038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19554bdf-d25c-4ede-9218-bef2194f8038', 'volume_size': 1} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2033066508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19554bdf-d25c-4ede-9218-bef2194f8038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:25Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Creating volume 19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:25 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:25 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 1073741824 Aug 28 16:38:25 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:25 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 1073741824" returned: 0 in 0.433s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:25 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:25 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 Aug 28 16:38:25 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:26 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea327b6-cb5b-4bb5-89fc-a0a98081cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19554bdf-d25c-4ede-9218-bef2194f8038', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6ddef9-c969-4f42-8049-9dc5a2f9d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:26 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Volume volume-19554bdf-d25c-4ede-9218-bef2194f8038 (19554bdf-d25c-4ede-9218-bef2194f8038): created successfully Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6ddef9-c969-4f42-8049-9dc5a2f9d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (984c4822-9c8d-48d3-ae0f-b52e8db13ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:26 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-e4a33635-fc2d-42eb-8173-4d3891d57ba9 tempest-ProjectReaderTests-1754453674 None] Created volume successfully. Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Creating offline snapshot 40fd4611-aaca-40f7-a5b2-d137ae01feb2 of volume 19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7953592-9e85-47e0-9269-9085cd401692]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:26 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 Aug 28 16:38:26 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:26 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038" returned: 0 in 0.341s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:26 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:26 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 1G Aug 28 16:38:26 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:27 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 1G" returned: 0 in 0.385s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19554bdf-d25c-4ede-9218-bef2194f8038 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:27 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19554bdf-d25c-4ede-9218-bef2194f8038 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 Aug 28 16:38:27 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:27 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19554bdf-d25c-4ede-9218-bef2194f8038 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2" returned: 0 in 0.290s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:27 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 is being set with open permissions: ugo+rw Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:27 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 Aug 28 16:38:27 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:27 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2" returned: 0 in 0.235s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:27 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:27 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info Aug 28 16:38:27 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:28 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info" returned: 0 in 0.271s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:28 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info is being set with open permissions: ugo+rw Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:28 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info Aug 28 16:38:28 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:28 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.info" returned: 0 in 0.259s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:28 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-7b116c8f-84d0-413e-831a-a642c2872f61 tempest-ProjectReaderTests-1754453674 None] Create snapshot completed successfully Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-40fd4611-aaca-40f7-a5b2-d137ae01feb2-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-40fd4611-aaca-40f7-a5b2-d137ae01feb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-40fd4611-aaca-40f7-a5b2-d137ae01feb2" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-40fd4611-aaca-40f7-a5b2-d137ae01feb2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Deleting offline snapshot 40fd4611-aaca-40f7-a5b2-d137ae01feb2 of volume 19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] snapshot_file for this snap is: volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0000c0c-eb71-4e83-8e6b-e01c433cbbfe]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:28 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:28 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 Aug 28 16:38:28 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:29 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19554bdf-d25c-4ede-9218-bef2194f8038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d999c7-93c0-4086-adb2-4b04128a37b3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:29 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 Aug 28 16:38:29 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:29 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038" returned: 0 in 0.384s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:29 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 Aug 28 16:38:29 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:29 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2" returned: 0 in 0.330s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:29 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:29 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2 Aug 28 16:38:29 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:30 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038.40fd4611-aaca-40f7-a5b2-d137ae01feb2" returned: 0 in 0.249s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-40fd4611-aaca-40f7-a5b2-d137ae01feb2" released by "_delete_snapshot" :: held 1.415s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" released by "delete_snapshot" :: held 1.436s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Created reservations ['238b868f-821e-42de-a22e-7cfe17149c7d', '23ff53ef-a9bc-4e6f-9f41-8db9ae01b60e', '67e661f2-3550-4c46-b716-08aa44ecd9b9', 'ed7d67f0-1396-48f6-9d87-c74ad570fc9d'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:30 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Delete snapshot completed successfully. Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-88981a4d-1a70-4fba-8ee6-c032d974646b tempest-ProjectReaderTests-1754453674 None] Lock "cinder-40fd4611-aaca-40f7-a5b2-d137ae01feb2-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-19554bdf-d25c-4ede-9218-bef2194f8038-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-19554bdf-d25c-4ede-9218-bef2194f8038-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7dd83f-3b55-482e-8404-6779f9d0f82b]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:30 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:31 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 Aug 28 16:38:31 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:31 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:31 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038 Aug 28 16:38:31 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:31 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:31 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:31 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-19554bdf-d25c-4ede-9218-bef2194f8038" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-19554bdf-d25c-4ede-9218-bef2194f8038" released by "delete_volume" :: held 0.686s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Created reservations ['a366b6f5-6f72-4573-9032-94616ac31f36', '66d5e5fe-d123-489b-b12d-f1df66dd0ac8', '54195c8a-4224-4712-a917-a2ea2260d526', '544d5406-282d-4004-be0f-b1c0c947e0ed'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:31 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.272s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:31 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:31 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:31 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.240s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:31 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Deleted volume successfully. Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c5f6d635-dafd-4e21-a86f-f284e3045d11 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-19554bdf-d25c-4ede-9218-bef2194f8038-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (5f35f52a-b61b-41d5-8acf-86ee2a252b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487faaad-1428-43ad-9cb2-8c049ceec4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487faaad-1428-43ad-9cb2-8c049ceec4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591913637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41a0f71-d897-4c4e-9127-32b3c3907fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:32Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d9d7b6-6d42-46ef-858d-c2e2791978cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d9d7b6-6d42-46ef-858d-c2e2791978cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cd06e8-86b6-4bbc-8cc6-f183dcee671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cd06e8-86b6-4bbc-8cc6-f183dcee671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41a0f71-d897-4c4e-9127-32b3c3907fcb', 'volume_name': 'volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4d2ab-9fec-4c60-8929-06d3a3d26b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a4d2ab-9fec-4c60-8929-06d3a3d26b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ffcf72-6e35-4001-be19-ff13085b7165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:32 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Volume e41a0f71-d897-4c4e-9127-32b3c3907fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb', 'volume_size': 1} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591913637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41a0f71-d897-4c4e-9127-32b3c3907fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:32Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Creating volume e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:32 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:32 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb 1073741824 Aug 28 16:38:32 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:32 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:32 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb 1073741824" returned: 0 in 0.412s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:33 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb Aug 28 16:38:33 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:33 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ffcf72-6e35-4001-be19-ff13085b7165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b81b45-af12-4580-b288-9a38229150fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:33 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Volume volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb (e41a0f71-d897-4c4e-9127-32b3c3907fcb): created successfully Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b81b45-af12-4580-b288-9a38229150fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (5f35f52a-b61b-41d5-8acf-86ee2a252b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:33 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8eda0d34-844f-49ee-8f05-8982f6bacc14 tempest-ProjectReaderTests-1754453674 None] Created volume successfully. Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Creating offline snapshot 8a89bac6-8a34-43c0-b225-d9173987515b of volume e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb41779-4592-47de-83cd-1f9f29bea1b3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:33 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:33 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb Aug 28 16:38:33 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:34 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:34 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b 1G Aug 28 16:38:34 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:34 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b 1G" returned: 0 in 0.388s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:34 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b Aug 28 16:38:34 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:34 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b" returned: 0 in 0.294s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:34 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b is being set with open permissions: ugo+rw Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:34 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b Aug 28 16:38:34 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:34 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:34 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:34 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info Aug 28 16:38:35 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:35 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info" returned: 0 in 0.247s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:35 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info is being set with open permissions: ugo+rw Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:35 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info Aug 28 16:38:35 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:35 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.info" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:35 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-6f97c49c-bbc7-4168-97c9-18c2dff1b2e9 tempest-ProjectReaderTests-1754453674 None] Create snapshot completed successfully Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-8a89bac6-8a34-43c0-b225-d9173987515b-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-8a89bac6-8a34-43c0-b225-d9173987515b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-8a89bac6-8a34-43c0-b225-d9173987515b" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-8a89bac6-8a34-43c0-b225-d9173987515b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Deleting offline snapshot 8a89bac6-8a34-43c0-b225-d9173987515b of volume e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] snapshot_file for this snap is: volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567fdfa-d00b-48ac-8d1d-35f56455395c]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:35 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:35 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b Aug 28 16:38:35 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:36 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b" returned: 0 in 0.366s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[083ad942-abc4-4812-8da7-732797b1803e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:36 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb Aug 28 16:38:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:36 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb" returned: 0 in 0.359s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:36 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b Aug 28 16:38:36 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:36 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b" returned: 0 in 0.335s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:36 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:36 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b Aug 28 16:38:36 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:37 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb.8a89bac6-8a34-43c0-b225-d9173987515b" returned: 0 in 0.244s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-8a89bac6-8a34-43c0-b225-d9173987515b" released by "_delete_snapshot" :: held 1.391s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" released by "delete_snapshot" :: held 1.412s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Created reservations ['0d3be476-08d5-4738-8b18-086f865c35e4', 'd0021996-f560-4797-8ed3-bbfab7008dfe', '965c84b8-8850-4572-b6d0-6071628927d3', 'e772f309-4ad3-4bf3-8de6-bf80c8bd4b52'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:37 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Delete snapshot completed successfully. Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-4964c16a-f2fa-4f44-b151-dcbf8dd53e89 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-8a89bac6-8a34-43c0-b225-d9173987515b-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-e41a0f71-d897-4c4e-9127-32b3c3907fcb-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "cinder-e41a0f71-d897-4c4e-9127-32b3c3907fcb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:37 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18bdc7-419a-48a8-a23f-af47eb478716]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:38 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb Aug 28 16:38:38 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:38 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb" returned: 0 in 0.358s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:38 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb Aug 28 16:38:38 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:38 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e41a0f71-d897-4c4e-9127-32b3c3907fcb" returned: 0 in 0.233s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-e41a0f71-d897-4c4e-9127-32b3c3907fcb" released by "delete_volume" :: held 0.648s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Created reservations ['5d72270b-b2f6-4511-b4b3-248d94aceefd', 'f290a117-1934-44c6-b409-e7a533237aec', '7aae176c-ccdb-4b11-b2df-fed82264ecc3', 'fc2091f4-4430-41cd-9f2f-39a2bd3a3b54'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:38 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:38 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:38 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:39 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.256s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:39 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Deleted volume successfully. Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-0add99ff-7e12-4cd3-90b3-3a0f20bcf1db tempest-ProjectReaderTests-1754453674 None] Lock "cinder-e41a0f71-d897-4c4e-9127-32b3c3907fcb-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (e3154f50-6ece-4c91-97e2-2a8ff08c00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7209565-515a-4c07-a894-1aa2f07bdf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7209565-515a-4c07-a894-1aa2f07bdf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976199233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecaffdd-3619-49cb-b517-860e04748fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:39Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac02d3-b05e-4e4d-b075-2085f66aa332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac02d3-b05e-4e4d-b075-2085f66aa332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9dc3f1-ad38-42d0-ad15-66f7f750d0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9dc3f1-ad38-42d0-ad15-66f7f750d0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecaffdd-3619-49cb-b517-860e04748fe2', 'volume_name': 'volume-9ecaffdd-3619-49cb-b517-860e04748fe2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86607bc-82ee-465d-adbd-d9771e14fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86607bc-82ee-465d-adbd-d9771e14fce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38baf7c0-c1ba-4bb0-b529-a10fb3233b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:39 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Volume 9ecaffdd-3619-49cb-b517-860e04748fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecaffdd-3619-49cb-b517-860e04748fe2', 'volume_size': 1} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976199233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecaffdd-3619-49cb-b517-860e04748fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ca4f2d6be9426c8cd89e36faa07d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:39Z,use_quota=True,user_id='4a4136f43931458e9db07e8554684c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Creating volume 9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:39 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:39 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:39 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 1073741824 Aug 28 16:38:39 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:40 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 1073741824" returned: 0 in 0.395s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:40 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 Aug 28 16:38:40 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:40 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38baf7c0-c1ba-4bb0-b529-a10fb3233b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecaffdd-3619-49cb-b517-860e04748fe2', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d0e1c-d5ea-4eaf-969d-8f04691e8b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:40 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Volume volume-9ecaffdd-3619-49cb-b517-860e04748fe2 (9ecaffdd-3619-49cb-b517-860e04748fe2): created successfully Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3d0e1c-d5ea-4eaf-969d-8f04691e8b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Flow 'volume_create_manager' (e3154f50-6ece-4c91-97e2-2a8ff08c00b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:40 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-56a252eb-4444-428b-a2a1-b0e43d3bce8b tempest-ProjectReaderTests-1754453674 None] Created volume successfully. Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Creating offline snapshot a63fd884-6649-42fa-9580-ba9420ec5062 of volume 9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e776a9-f2d3-485b-9635-fe947fbde9c6]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:40 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:40 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 Aug 28 16:38:40 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:41 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2" returned: 0 in 0.342s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 1G {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:41 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 1G Aug 28 16:38:41 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:41 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 1G" returned: 0 in 0.366s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaffdd-3619-49cb-b517-860e04748fe2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:41 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaffdd-3619-49cb-b517-860e04748fe2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 Aug 28 16:38:41 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:41 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecaffdd-3619-49cb-b517-860e04748fe2 -F qcow2 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062" returned: 0 in 0.281s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:41 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 is being set with open permissions: ugo+rw Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:41 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 Aug 28 16:38:41 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:41 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062" returned: 0 in 0.238s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:41 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:41 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info Aug 28 16:38:41 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:42 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info" returned: 0 in 0.258s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:42 devstack cinder-volume[86193]: WARNING cinder.volume.drivers.remotefs [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info is being set with open permissions: ugo+rw Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:42 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info Aug 28 16:38:42 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:42 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.info" returned: 0 in 0.248s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:42 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f97b7c26-1359-48e3-a108-0e50fa712951 tempest-ProjectReaderTests-1754453674 None] Create snapshot completed successfully Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-a63fd884-6649-42fa-9580-ba9420ec5062-delete_snapshot" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-a63fd884-6649-42fa-9580-ba9420ec5062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" by "delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-a63fd884-6649-42fa-9580-ba9420ec5062" by "_delete_snapshot" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-a63fd884-6649-42fa-9580-ba9420ec5062" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Deleting offline snapshot a63fd884-6649-42fa-9580-ba9420ec5062 of volume 9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] snapshot_file for this snap is: volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac626f-dc47-4870-90de-19bff401dd3d]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:42 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:42 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 Aug 28 16:38:42 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:43 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062" returned: 0 in 0.349s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecaffdd-3619-49cb-b517-860e04748fe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86193) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a0f98-4920-49b9-b131-70776b3f9a86]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:43 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 Aug 28 16:38:43 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:43 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2" returned: 0 in 0.344s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:43 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 Aug 28 16:38:43 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:43 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062" returned: 0 in 0.322s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:43 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:43 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062 Aug 28 16:38:43 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:44 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2.a63fd884-6649-42fa-9580-ba9420ec5062" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-a63fd884-6649-42fa-9580-ba9420ec5062" released by "_delete_snapshot" :: held 1.341s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" released by "delete_snapshot" :: held 1.363s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Created reservations ['d64c0d41-e6e5-4529-9f06-d6e65f0b81de', '096bf5ee-a58f-4d55-9ca7-0ed41b73a72a', 'ac04f342-7cb3-4fd3-8a5f-471f43e6aee5', '3a4c4f96-0f75-4877-aa67-6695ad018065'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:44 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Delete snapshot completed successfully. Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-8d6d6f45-9bcc-4a7b-bb66-88b942475604 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-a63fd884-6649-42fa-9580-ba9420ec5062-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-9ecaffdd-3619-49cb-b517-860e04748fe2-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-9ecaffdd-3619-49cb-b517-860e04748fe2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:44 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" acquired by "delete_volume" :: waited 0.015s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[770b4fad-7a92-4446-9bf5-5442a33908c8]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:45 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 Aug 28 16:38:45 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:45 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2" returned: 0 in 0.355s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:45 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2 Aug 28 16:38:45 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:45 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9ecaffdd-3619-49cb-b517-860e04748fe2" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-quobyte-9ecaffdd-3619-49cb-b517-860e04748fe2" released by "delete_volume" :: held 0.657s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Created reservations ['d64be753-deb9-4746-bbb0-86caff0d5ef6', '580399ee-c2ec-48bc-b553-b0bec33e89f3', '328faa23-fbea-42bf-9f3b-5dc101d2a5a8', '5fdb036e-84da-48ed-a79c-dacee9c4ab41'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:45 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:45 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:45 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:46 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:46 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.254s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:46 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:46 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Deleted volume successfully. Aug 28 16:38:46 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-a3ac0125-d1ea-484a-8fbc-c812831aee41 tempest-ProjectReaderTests-1754453674 None] Lock "cinder-9ecaffdd-3619-49cb-b517-860e04748fe2-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:55 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=90,cinder:DELETE=10,cinder:INSERT=35,cinder:UPDATE=129 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:38:56 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Flow 'volume_create_manager' (f0157309-5070-49d7-b045-5c91f58d83e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be06b6a1-558d-4190-85eb-5602b1fd9c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be06b6a1-558d-4190-85eb-5602b1fd9c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94700444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c50e45e-d672-4e73-8451-e760ab98d2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d625f230814d3bbc42c4db9f019c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:57Z,use_quota=True,user_id='4d565bb1afba44419f723bd6e1c43f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4016134-7a40-4967-b7a8-1864f17b0ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4016134-7a40-4967-b7a8-1864f17b0ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21f9130-767d-49d7-acf4-fc6e88522f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21f9130-767d-49d7-acf4-fc6e88522f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c50e45e-d672-4e73-8451-e760ab98d2a6', 'volume_name': 'volume-9c50e45e-d672-4e73-8451-e760ab98d2a6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd47b08-e906-4680-a6c4-620607930205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd47b08-e906-4680-a6c4-620607930205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645703fa-ac0a-4181-9876-28b0fd204d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:57 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Volume 9c50e45e-d672-4e73-8451-e760ab98d2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c50e45e-d672-4e73-8451-e760ab98d2a6', 'volume_size': 1} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-94700444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c50e45e-d672-4e73-8451-e760ab98d2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d625f230814d3bbc42c4db9f019c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:38:57Z,use_quota=True,user_id='4d565bb1afba44419f723bd6e1c43f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Creating volume 9c50e45e-d672-4e73-8451-e760ab98d2a6 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:38:57 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:57 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 1073741824 Aug 28 16:38:57 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:57 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 1073741824" returned: 0 in 0.399s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:57 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:58 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 Aug 28 16:38:58 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:58 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645703fa-ac0a-4181-9876-28b0fd204d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c50e45e-d672-4e73-8451-e760ab98d2a6', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18527014-78c4-47de-b78d-09209b1e9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:38:58 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Volume volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 (9c50e45e-d672-4e73-8451-e760ab98d2a6): created successfully Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18527014-78c4-47de-b78d-09209b1e9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Flow 'volume_create_manager' (f0157309-5070-49d7-b045-5c91f58d83e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:38:58 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d6d12291-17e4-44dc-af86-d7e122782a86 tempest-ProjectReaderTests-961848573 None] Created volume successfully. Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Acquiring lock "cinder-9c50e45e-d672-4e73-8451-e760ab98d2a6-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "cinder-9c50e45e-d672-4e73-8451-e760ab98d2a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Acquiring lock "cinder-quobyte-9c50e45e-d672-4e73-8451-e760ab98d2a6" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "cinder-quobyte-9c50e45e-d672-4e73-8451-e760ab98d2a6" acquired by "delete_volume" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a1c3d-4996-463b-8b3d-768bc83ca91e]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:38:58 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:58 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 Aug 28 16:38:58 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:59 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6" returned: 0 in 0.345s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:59 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6 Aug 28 16:38:59 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:59 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-9c50e45e-d672-4e73-8451-e760ab98d2a6" returned: 0 in 0.245s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "cinder-quobyte-9c50e45e-d672-4e73-8451-e760ab98d2a6" released by "delete_volume" :: held 0.626s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Created reservations ['642c6d18-b2b7-475e-a3c2-04f3b2de1cb7', 'd3c8b162-7391-4926-a05e-32b37cb8d911', 'f3e98c5a-3bc9-4324-82d2-573a4f7a047f', '06d0cc5c-ac69-4aa7-bd97-f088fd2e077e'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:38:59 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:38:59 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:38:59 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:38:59 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Deleted volume successfully. Aug 28 16:38:59 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-b7159c21-9831-4062-8bc2-d2739b34bae6 tempest-ProjectReaderTests-961848573 None] Lock "cinder-9c50e45e-d672-4e73-8451-e760ab98d2a6-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Flow 'volume_create_manager' (a041924e-3c1b-4307-bc64-438df76ab655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ea3e25-2b38-4a8a-8bfb-24de38c61aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ea3e25-2b38-4a8a-8bfb-24de38c61aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54383310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bdc8c1-e81d-4e88-abf3-106eec9cefd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d625f230814d3bbc42c4db9f019c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:00Z,use_quota=True,user_id='4d565bb1afba44419f723bd6e1c43f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c6b282-48d4-4491-8d9e-a1156f1de137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c6b282-48d4-4491-8d9e-a1156f1de137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76d78a-8579-4edc-97a5-0234397d7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab76d78a-8579-4edc-97a5-0234397d7469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bdc8c1-e81d-4e88-abf3-106eec9cefd5', 'volume_name': 'volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a86496-e563-4e08-912d-6a274ba241bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a86496-e563-4e08-912d-6a274ba241bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442fcd0f-fc98-4ba1-9a7c-44ddf9959d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:00 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Volume 21bdc8c1-e81d-4e88-abf3-106eec9cefd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5', 'volume_size': 1} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-54383310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bdc8c1-e81d-4e88-abf3-106eec9cefd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d625f230814d3bbc42c4db9f019c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:00Z,use_quota=True,user_id='4d565bb1afba44419f723bd6e1c43f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Creating volume 21bdc8c1-e81d-4e88-abf3-106eec9cefd5 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:39:00 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:00 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 1073741824 Aug 28 16:39:00 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:00 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 1073741824" returned: 0 in 0.399s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:00 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 Aug 28 16:39:00 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:00 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442fcd0f-fc98-4ba1-9a7c-44ddf9959d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:00 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d335d1eb-b8c5-4c0e-847b-29dcbf06cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:01 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Volume volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 (21bdc8c1-e81d-4e88-abf3-106eec9cefd5): created successfully Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d335d1eb-b8c5-4c0e-847b-29dcbf06cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Flow 'volume_create_manager' (a041924e-3c1b-4307-bc64-438df76ab655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:01 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-54ad3b48-60d3-491c-9edd-dbc1e61f0fa5 tempest-ProjectReaderTests-961848573 None] Created volume successfully. Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Acquiring lock "cinder-21bdc8c1-e81d-4e88-abf3-106eec9cefd5-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "cinder-21bdc8c1-e81d-4e88-abf3-106eec9cefd5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Acquiring lock "cinder-quobyte-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "cinder-quobyte-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" acquired by "delete_volume" :: waited 0.012s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[5082f22d-6ffa-41f7-b9b5-5152d480e2a0]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:01 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 Aug 28 16:39:01 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:01 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" returned: 0 in 0.351s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:01 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5 Aug 28 16:39:01 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:01 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" returned: 0 in 0.231s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "cinder-quobyte-21bdc8c1-e81d-4e88-abf3-106eec9cefd5" released by "delete_volume" :: held 0.619s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:01 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Created reservations ['7dd9ff86-7943-4a6c-b5c6-8c39aa57548a', 'e2b2c8d2-7533-4df5-a78a-8d2df3aa628b', '53d32c54-dc97-4beb-9c7d-3d6f1bb0c3b5', '4ab027fa-c7a8-4e17-8648-116e4f515a1a'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:02 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:02 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:02 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.233s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:02 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Deleted volume successfully. Aug 28 16:39:02 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-d77d25b5-0787-497d-833a-d7bd88899e2e tempest-ProjectReaderTests-961848573 None] Lock "cinder-21bdc8c1-e81d-4e88-abf3-106eec9cefd5-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (595ecd18-30a1-4421-bdf3-f54f91de6cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cf2405-8c63-490c-b5eb-b2f64be94c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cf2405-8c63-490c-b5eb-b2f64be94c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135401325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dce7ab8-0948-4d0d-bf6b-12792af2c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:06Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de33db91-97fb-44aa-ae29-a27dffdba6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de33db91-97fb-44aa-ae29-a27dffdba6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b1d20-96a4-4096-9b22-070144e5308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b1d20-96a4-4096-9b22-070144e5308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dce7ab8-0948-4d0d-bf6b-12792af2c804', 'volume_name': 'volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b36d99b-c1aa-441a-ba62-85cba065ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b36d99b-c1aa-441a-ba62-85cba065ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30977735-dfe9-4db0-85e3-d375bbda1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:05 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Volume 1dce7ab8-0948-4d0d-bf6b-12792af2c804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804', 'volume_size': 1} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-135401325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dce7ab8-0948-4d0d-bf6b-12792af2c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:06Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Creating volume 1dce7ab8-0948-4d0d-bf6b-12792af2c804 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:39:05 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:39:05 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:05 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 1073741824 Aug 28 16:39:05 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:06 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 1073741824" returned: 0 in 0.397s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:06 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 Aug 28 16:39:06 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:06 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804" returned: 0 in 0.236s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30977735-dfe9-4db0-85e3-d375bbda1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db14d9f-80be-40f1-bf48-d71c191e8e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:06 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Volume volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 (1dce7ab8-0948-4d0d-bf6b-12792af2c804): created successfully Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db14d9f-80be-40f1-bf48-d71c191e8e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (595ecd18-30a1-4421-bdf3-f54f91de6cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:06 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-50837767-b7ad-453c-a45f-33c2ecd5e533 tempest-ProjectReaderTests-689759052 None] Created volume successfully. Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-1dce7ab8-0948-4d0d-bf6b-12792af2c804-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "cinder-1dce7ab8-0948-4d0d-bf6b-12792af2c804-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-quobyte-1dce7ab8-0948-4d0d-bf6b-12792af2c804" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-1dce7ab8-0948-4d0d-bf6b-12792af2c804" acquired by "delete_volume" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5994904-6c4b-461d-aef5-06158bfabcc3]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:39:06 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:07 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 Aug 28 16:39:07 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:07 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804" returned: 0 in 0.352s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:07 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804 Aug 28 16:39:07 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:07 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-1dce7ab8-0948-4d0d-bf6b-12792af2c804" returned: 0 in 0.240s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-1dce7ab8-0948-4d0d-bf6b-12792af2c804" released by "delete_volume" :: held 0.633s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Created reservations ['9c9638a0-34bf-444b-bb99-0ec4713b745f', '0f9ba3ac-4821-4914-bcc4-e85739908bf1', '0acf4aca-9eda-4aac-9736-8bcbdd3724fe', '015bb409-eb95-4a7b-a76c-dd8506d84219'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:07 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:07 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:07 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.244s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:07 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Deleted volume successfully. Aug 28 16:39:07 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-922bc482-eb78-47e2-822c-86244b45d7f8 tempest-ProjectReaderTests-689759052 None] Lock "cinder-1dce7ab8-0948-4d0d-bf6b-12792af2c804-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (d80420bd-37dc-4c72-bfcd-a42a1ef5f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b280d8-2d34-4bb2-a8bb-35675ba71cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b280d8-2d34-4bb2-a8bb-35675ba71cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239962504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe30cf5-0766-46f3-8d08-93b27361ca02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:08Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc0efa9-0387-4dbb-8263-40ee2e36982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc0efa9-0387-4dbb-8263-40ee2e36982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c528fe6-d151-408f-8f12-95c463f3eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c528fe6-d151-408f-8f12-95c463f3eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe30cf5-0766-46f3-8d08-93b27361ca02', 'volume_name': 'volume-2fe30cf5-0766-46f3-8d08-93b27361ca02', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818225d-57ab-401f-858f-8ae3e267b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818225d-57ab-401f-858f-8ae3e267b9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b75c5a-7724-44d2-8eb4-80efd9826916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:08 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Volume 2fe30cf5-0766-46f3-8d08-93b27361ca02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe30cf5-0766-46f3-8d08-93b27361ca02', 'volume_size': 1} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1239962504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe30cf5-0766-46f3-8d08-93b27361ca02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:08Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Creating volume 2fe30cf5-0766-46f3-8d08-93b27361ca02 {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:39:08 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:08 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 1073741824 Aug 28 16:39:08 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:08 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 1073741824" returned: 0 in 0.405s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:08 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:08 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 Aug 28 16:39:08 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:09 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02" returned: 0 in 0.237s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b75c5a-7724-44d2-8eb4-80efd9826916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe30cf5-0766-46f3-8d08-93b27361ca02', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352486f8-1c73-44c2-9fd1-2a55a0178577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:09 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Volume volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 (2fe30cf5-0766-46f3-8d08-93b27361ca02): created successfully Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352486f8-1c73-44c2-9fd1-2a55a0178577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (d80420bd-37dc-4c72-bfcd-a42a1ef5f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:09 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-ce5a08a6-7d83-46aa-9daf-4bc5e4d2d81c tempest-ProjectReaderTests-689759052 None] Created volume successfully. Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-2fe30cf5-0766-46f3-8d08-93b27361ca02-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "cinder-2fe30cf5-0766-46f3-8d08-93b27361ca02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-quobyte-2fe30cf5-0766-46f3-8d08-93b27361ca02" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-2fe30cf5-0766-46f3-8d08-93b27361ca02" acquired by "delete_volume" :: waited 0.013s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f597e23-7794-49cf-9999-deea098fa2ef]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:09 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 Aug 28 16:39:09 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:09 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02" returned: 0 in 0.346s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:09 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:09 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02 Aug 28 16:39:09 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:10 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-2fe30cf5-0766-46f3-8d08-93b27361ca02" returned: 0 in 0.235s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-2fe30cf5-0766-46f3-8d08-93b27361ca02" released by "delete_volume" :: held 0.619s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Created reservations ['e0bed33d-2aba-42ac-a376-e0d5df445412', '355d915f-5d82-4653-8209-57b735b4c9f6', '80a3fb39-1a12-4166-adfe-931c6899b07c', '1a13e2b0-65a6-421a-b87a-2808f4884f6c'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:10 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:10 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:10 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.251s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:10 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Deleted volume successfully. Aug 28 16:39:10 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-91d41934-fbb4-4839-97db-f0ebf4e03ec4 tempest-ProjectReaderTests-689759052 None] Lock "cinder-2fe30cf5-0766-46f3-8d08-93b27361ca02-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (11e1c967-c1f2-4dc2-8678-e9c99a0fa863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3cdcb8-23a0-4fe3-bc91-a7134fe1e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3cdcb8-23a0-4fe3-bc91-a7134fe1e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412370950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:11Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bebac92-2d55-4579-b3ae-1aa9e1e03293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bebac92-2d55-4579-b3ae-1aa9e1e03293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c4662-af71-4813-acee-583d1d42924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c4662-af71-4813-acee-583d1d42924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e', 'volume_name': 'volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa914f1-9be0-4810-8dd1-a881870119cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa914f1-9be0-4810-8dd1-a881870119cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad8ed00-9cb4-453b-ac38-4e38b2eaa091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Volume 4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e', 'volume_size': 1} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-412370950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:11Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Creating volume 4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:39:11 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:11 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e 1073741824 Aug 28 16:39:11 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:11 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e 1073741824" returned: 0 in 0.387s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:11 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e Aug 28 16:39:11 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:11 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" returned: 0 in 0.232s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad8ed00-9cb4-453b-ac38-4e38b2eaa091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba6fa1-6ff2-439a-b3b1-b710cf8dda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:11 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Volume volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e (4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e): created successfully Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cba6fa1-6ff2-439a-b3b1-b710cf8dda45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:11 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (11e1c967-c1f2-4dc2-8678-e9c99a0fa863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:11 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-3b0d0695-4467-449a-ba7c-cf55ae43e9d4 tempest-ProjectReaderTests-689759052 None] Created volume successfully. Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "cinder-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-quobyte-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" acquired by "delete_volume" :: waited 0.018s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52027a7-68aa-42c5-b5a0-5f3fed48f887]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:12 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e Aug 28 16:39:12 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:12 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" returned: 0 in 0.362s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:12 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e Aug 28 16:39:12 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:12 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" returned: 0 in 0.232s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e" released by "delete_volume" :: held 0.638s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:12 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Created reservations ['974107cd-809f-4a47-b748-4e4acd177e19', 'e4e13d39-9958-4751-bdd7-0ba5bd003865', 'ee6c52da-f818-4c72-9293-055b0a09bd84', '0b767cf8-5260-4007-91ef-ba01f1e292ca'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:13 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:13 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:13 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.252s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:13 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Deleted volume successfully. Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-f551cf68-ff42-432a-9cf7-390dafe933a2 tempest-ProjectReaderTests-689759052 None] Lock "cinder-4a1bcb69-3ecc-4419-afe7-3c68dd4ad32e-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86193) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (0fb97c1e-b237-47af-8e40-461a722b1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58e31cb-aebb-448c-9bb8-c8f8ca241e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58e31cb-aebb-448c-9bb8-c8f8ca241e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472714069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53ecdd1-32ef-43cd-9018-f43da2f49a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:14Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca8bcc5-3982-479e-98e7-126e6eef2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca8bcc5-3982-479e-98e7-126e6eef2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82c0904-bfa0-493e-90af-0f0fbdcdd2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82c0904-bfa0-493e-90af-0f0fbdcdd2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53ecdd1-32ef-43cd-9018-f43da2f49a2f', 'volume_name': 'volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01a4d11-c031-4ad7-a3d2-622eeef69f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01a4d11-c031-4ad7-a3d2-622eeef69f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccae5256-e5bc-4fc1-a216-c55aa2866c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:13 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Volume e53ecdd1-32ef-43cd-9018-f43da2f49a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f', 'volume_size': 1} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T14:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472714069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53ecdd1-32ef-43cd-9018-f43da2f49a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='085754b03bc144508dcaf21f2b108c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T14:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T14:39:14Z,use_quota=True,user_id='3cd99e2fb6be45318646018188fa0fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2448f9-e2d7-4895-adc0-d42198b3258f),volume_type_id=6f2448f9-e2d7-4895-adc0-d42198b3258f)}" {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.remotefs [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Creating volume e53ecdd1-32ef-43cd-9018-f43da2f49a2f {{(pid=86193) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Selected osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa as target Quobyte volume. {{(pid=86193) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 16:39:13 devstack cinder-volume[86193]: INFO cinder.volume.drivers.remotefs [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] casted to osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa Aug 28 16:39:13 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f 1073741824 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:13 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f 1073741824 Aug 28 16:39:13 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:14 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f 1073741824" returned: 0 in 0.402s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:14 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f Aug 28 16:39:14 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:14 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" returned: 0 in 0.253s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'} {{(pid=86193) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccae5256-e5bc-4fc1-a216-c55aa2866c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f', 'volume_size': 1}' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36825bfb-a9a8-4319-b9fb-c580e91a7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 16:39:14 devstack cinder-volume[86193]: INFO cinder.volume.flows.manager.create_volume [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Volume volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f (e53ecdd1-32ef-43cd-9018-f43da2f49a2f): created successfully Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36825bfb-a9a8-4319-b9fb-c580e91a7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86193) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Flow 'volume_create_manager' (0fb97c1e-b237-47af-8e40-461a722b1b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86193) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 16:39:14 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-f5569e6a-47a4-4e09-96ab-189e9b39fd4c tempest-ProjectReaderTests-689759052 None] Created volume successfully. Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-e53ecdd1-32ef-43cd-9018-f43da2f49a2f-delete_volume" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "cinder-e53ecdd1-32ef-43cd-9018-f43da2f49a2f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Acquiring lock "cinder-quobyte-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" by "delete_volume" {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" acquired by "delete_volume" :: waited 0.019s {{(pid=86193) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9810b4-5d51-4323-8fa1-60845c4cfc20]: (4, 'qcow2') {{(pid=87665) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 16:39:14 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:15 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f Aug 28 16:39:15 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:15 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" returned: 0 in 0.354s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:15 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f Aug 28 16:39:15 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:15 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9/volume-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" returned: 0 in 0.242s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "cinder-quobyte-e53ecdd1-32ef-43cd-9018-f43da2f49a2f" released by "delete_volume" :: held 0.638s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.quota [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Created reservations ['ba745669-ae5c-4960-8896-d8f8cb095ba4', '03763cf1-b724-4dce-bbac-fab604ae7b3b', '864eb340-b014-4564-831f-a122365277e2', 'af853d57-5e8c-4f91-bc9d-4e0c374ecb43'] {{(pid=86193) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:15 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:15 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:15 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.235s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:15 devstack cinder-volume[86193]: INFO cinder.volume.manager [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Deleted volume successfully. Aug 28 16:39:15 devstack cinder-volume[86193]: DEBUG cinder.coordination [None req-c2ddba36-e8e7-43d9-adac-e148dcd8bace tempest-ProjectReaderTests-689759052 None] Lock "cinder-e53ecdd1-32ef-43cd-9018-f43da2f49a2f-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86193) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 16:39:25 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=45,cinder:UPDATE=67,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:39:25 devstack cinder-volume[86193]: DEBUG dbcounter [-] [86193] Writing DB stats cinder:SELECT=40,cinder:UPDATE=66,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa': None} {{(pid=86193) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG cinder.volume.drivers.quobyte [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1fc32eae-951b-43f7-97b1-d5bcb72f6cfa'] {{(pid=86193) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.lockutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86193) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 16:39:31 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9 Aug 28 16:39:31 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 16:39:31 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_concurrency.processutils [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cb15b9a419addfff2481ffb223ec22a9" returned: 0 in 0.250s {{(pid=86193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG cinder.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Notifying Schedulers of capabilities ... {{(pid=86193) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG oslo_service.periodic_task [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] Running periodic task VolumeManager._thread_info {{(pid=86193) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread count: 28 {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 16:39:31 devstack cinder-volume[86193]: DEBUG cinder.volume.manager [None req-f4b802cd-1634-4285-9c7a-7644d714c1bb None None] thread info: [<_MainThread(MainThread, started 126444239626368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86193) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}